CN113378001B - Video playing progress adjusting method and device, electronic equipment and medium - Google Patents
Video playing progress adjusting method and device, electronic equipment and medium Download PDFInfo
- Publication number
- CN113378001B CN113378001B CN202110721630.8A CN202110721630A CN113378001B CN 113378001 B CN113378001 B CN 113378001B CN 202110721630 A CN202110721630 A CN 202110721630A CN 113378001 B CN113378001 B CN 113378001B
- Authority
- CN
- China
- Prior art keywords
- subtitles
- video
- playing
- time
- subtitle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000004044 response Effects 0.000 claims description 6
- 238000009432 framing Methods 0.000 claims description 3
- 238000004590 computer program Methods 0.000 abstract description 13
- 238000004891 communication Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012015 optical character recognition Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/74—Browsing; Visualisation therefor
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
Abstract
The disclosure provides a method, a device, an electronic device, a computer readable storage medium and a computer program product for adjusting video playing progress, and relates to the field of computers, in particular to the technical field of video terminals. The implementation scheme is as follows: acquiring first playing time corresponding to a first number of subtitles corresponding to the video in the video; responding to a first trigger operation for adjusting the video playing progress, and determining a second playing time corresponding to the first trigger operation; acquiring a second number of subtitles associated with a second play time from the first number of subtitles based on the first play time, the second number being less than or equal to the first number; and responding to a second triggering operation for a first subtitle in the second number of subtitles, adjusting the playing progress of the video to a first playing time corresponding to the first subtitle, wherein the first subtitle is any subtitle in the second number of subtitles.
Description
Technical Field
The present disclosure relates to the field of computers, and in particular, to the field of video terminal technologies, and in particular, to a method and apparatus for adjusting video playing progress, an electronic device, a computer readable storage medium, and a computer program product.
Background
The popularization of the mobile internet has become a normal state when people use mobile phones to access the internet, and the higher-speed and stable mobile network has made it possible for users to view high-quality contents under the mobile network.
In the process of watching the video, the user may need to adjust the playing progress of the video to meet different watching demands of the user. Currently, progress and back of the progress bar are generally adjusted by a sliding motion based on a gesture. However, in general, the screen of the video playing device may be smaller, the length of the progress bar is limited, and the user may need to slide back and forth the progress bar multiple times in order to adjust to the playing position of interest, so that the accuracy is difficult to be ensured, and the content browsing experience of the user is not facilitated.
Disclosure of Invention
The present disclosure provides a method, apparatus, electronic device, computer-readable storage medium, and computer program product for adjusting video playback progress.
According to an aspect of the present disclosure, there is provided a method for adjusting video playing progress, including: acquiring a first number of subtitles corresponding to the video and first playing time corresponding to the first number of subtitles in the video respectively; responding to a first trigger operation for adjusting the video playing progress, and determining a second playing time corresponding to the first trigger operation; acquiring a second number of subtitles associated with the second play time from the first number of subtitles based on the first play time, wherein the second number is less than or equal to the first number; and responding to a second triggering operation for a first subtitle in the second number of subtitles, and adjusting the playing progress of the video to a first playing time corresponding to the first subtitle, wherein the first subtitle is any subtitle in the second number of subtitles.
According to another aspect of the present disclosure, there is provided an apparatus for adjusting video playing progress, including: a first obtaining unit configured to obtain a first number of subtitles corresponding to the video and first playing times of the first number of subtitles respectively corresponding to the video; the determining unit is configured to respond to a first trigger operation for adjusting the video playing progress and determine a second playing time corresponding to the first trigger operation; a second acquisition unit configured to acquire a second number of subtitles associated with the second play time from among the first number of subtitles based on the first play time, wherein the second number is smaller than or equal to the first number; and a play progress adjustment unit configured to adjust the play progress of the video to a first play time corresponding to a first subtitle in response to a second trigger operation for the first subtitle in the second number of subtitles, the first subtitle being any subtitle in the second number of subtitles.
According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the methods described in the present disclosure.
According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the method described in the present disclosure.
According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method described in the present disclosure.
According to one or more embodiments of the present disclosure, the playing progress of the video can be accurately adjusted based on the subtitles, which helps the user reduce unnecessary operations and save the time of repeated viewing, and improves the efficiency and experience of the user for viewing the video.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.
Drawings
The accompanying drawings illustrate exemplary embodiments and, together with the description, serve to explain exemplary implementations of the embodiments. The illustrated embodiments are for exemplary purposes only and do not limit the scope of the claims. Throughout the drawings, identical reference numerals designate similar, but not necessarily identical, elements.
FIG. 1 illustrates a schematic diagram of an exemplary system in which various methods described herein may be implemented, in accordance with an embodiment of the present disclosure;
FIG. 2 illustrates a flowchart of a method of adjusting video playback progress in accordance with an embodiment of the present disclosure;
FIG. 3 illustrates a flow chart for acquiring subtitles and their corresponding play times, according to an embodiment of the disclosure;
fig. 4 illustrates a flowchart of acquiring subtitles and their corresponding play times according to another embodiment of the disclosure;
fig. 5 illustrates a schematic diagram of adjusting a playback progress based on subtitles according to an embodiment of the disclosure;
fig. 6 shows a block diagram of a structure of an adjusting apparatus of video play progress according to an embodiment of the present disclosure; and
fig. 7 illustrates a block diagram of an exemplary electronic device that can be used to implement embodiments of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
In the present disclosure, the use of the terms "first," "second," and the like to describe various elements is not intended to limit the positional relationship, timing relationship, or importance relationship of the elements, unless otherwise indicated, and such terms are merely used to distinguish one element from another. In some examples, a first element and a second element may refer to the same instance of the element, and in some cases, they may also refer to different instances based on the description of the context.
The terminology used in the description of the various illustrated examples in this disclosure is for the purpose of describing particular examples only and is not intended to be limiting. Unless the context clearly indicates otherwise, the elements may be one or more if the number of the elements is not specifically limited. Furthermore, the term "and/or" as used in this disclosure encompasses any and all possible combinations of the listed items.
Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.
Fig. 1 illustrates a schematic diagram of an exemplary system 100 in which various methods and apparatus described herein may be implemented, in accordance with an embodiment of the present disclosure. Referring to fig. 1, the system 100 includes one or more client devices 101, 102, 103, 104, 105, and 106, a server 120, and one or more communication networks 110 coupling the one or more client devices to the server 120. Client devices 101, 102, 103, 104, 105, and 106 may be configured to execute one or more applications.
In an embodiment of the present disclosure, the server 120 may run one or more services or software applications that enable execution of the method of adjusting video playback progress.
In some embodiments, server 120 may also provide other services or software applications that may include non-virtual environments and virtual environments. In some embodiments, these services may be provided as web-based services or cloud services, for example, provided to users of client devices 101, 102, 103, 104, 105, and/or 106 under a software as a service (SaaS) model.
In the configuration shown in fig. 1, server 120 may include one or more components that implement the functions performed by server 120. These components may include software components, hardware components, or a combination thereof that are executable by one or more processors. A user operating client devices 101, 102, 103, 104, 105, and/or 106 may in turn utilize one or more client applications to interact with server 120 to utilize the services provided by these components. It should be appreciated that a variety of different system configurations are possible, which may differ from system 100. Accordingly, FIG. 1 is one example of a system for implementing the various methods described herein and is not intended to be limiting.
The user may play video, adjust video play progress, etc. using client devices 101, 102, 103, 104, 105, and/or 106. The client device may provide an interface that enables a user of the client device to interact with the client device. The client device may also output information to the user via the interface. Although fig. 1 depicts only six client devices, those skilled in the art will appreciate that the present disclosure may support any number of client devices.
Client devices 101, 102, 103, 104, 105, and/or 106 may include various types of computer devices, such as portable handheld devices, general purpose computers (such as personal computers and laptop computers), workstation computers, wearable devices, gaming systems, thin clients, various messaging devices, sensors or other sensing devices, and the like. These computer devices may run various types and versions of software applications and operating systems, such as MICROSOFT Windows, appli OS, UNIX-like operating systems, linux, or Linux-like operating systems (e.g., google Chrome OS); or include various mobile operating systems such as MICROSOFT Windows Mobile OS, iOS, windows Phone, android. Portable handheld devices may include cellular telephones, smart phones, tablet computers, personal Digital Assistants (PDAs), and the like. Wearable devices may include head mounted displays and other devices. The gaming system may include various handheld gaming devices, internet-enabled gaming devices, and the like. The client device is capable of executing a variety of different applications, such as various Internet-related applications, communication applications (e.g., email applications), short Message Service (SMS) applications, and may use a variety of communication protocols.
Network 110 may be any type of network known to those skilled in the art that may support data communications using any of a number of available protocols, including but not limited to TCP/IP, SNA, IPX, etc. For example only, the one or more networks 110 may be a Local Area Network (LAN), an ethernet-based network, a token ring, a Wide Area Network (WAN), the internet, a virtual network, a Virtual Private Network (VPN), an intranet, an extranet, a Public Switched Telephone Network (PSTN), an infrared network, a wireless network (e.g., bluetooth, WIFI), and/or any combination of these and/or other networks.
The server 120 may include one or more general purpose computers, special purpose server computers (e.g., PC (personal computer) servers, UNIX servers, mid-end servers), blade servers, mainframe computers, server clusters, or any other suitable arrangement and/or combination. The server 120 may include one or more virtual machines running a virtual operating system, or other computing architecture that involves virtualization (e.g., one or more flexible pools of logical storage devices that may be virtualized to maintain virtual storage devices of the server). In various embodiments, server 120 may run one or more services or software applications that provide the functionality described below.
The computing units in server 120 may run one or more operating systems including any of the operating systems described above as well as any commercially available server operating systems. Server 120 may also run any of a variety of additional server applications and/or middle tier applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, etc.
In some implementations, server 120 may include one or more applications to analyze and consolidate data feeds and/or event updates received from users of client devices 101, 102, 103, 104, 105, and 106. Server 120 may also include one or more applications to display data feeds and/or real-time events via one or more display devices of client devices 101, 102, 103, 104, 105, and 106.
In some implementations, the server 120 may be a server of a distributed system or a server that incorporates a blockchain. The server 120 may also be a cloud server, or an intelligent cloud computing server or intelligent cloud host with artificial intelligence technology. The cloud server is a host product in a cloud computing service system, so as to solve the defects of large management difficulty and weak service expansibility in the traditional physical host and virtual private server (VPS, virtual Private Server) service.
The system 100 may also include one or more databases 130. In some embodiments, these databases may be used to store data and other information. For example, one or more of the databases 130 may be used to store data such as video, subtitles, and the like. The data store 130 may reside in a variety of locations. For example, the data store used by the server 120 may be local to the server 120, or may be remote from the server 120 and may communicate with the server 120 via a network-based or dedicated connection. The data store 130 may be of different types. In some embodiments, the data store used by server 120 may be a database, such as a relational database. One or more of these databases may store, update, and retrieve the databases and data from the databases in response to the commands.
In some embodiments, one or more of databases 130 may also be used by applications to store application data. The databases used by the application may be different types of databases, such as key value stores, object stores, or conventional stores supported by the file system.
The system 100 of fig. 1 may be configured and operated in various ways to enable application of the various methods and apparatus described in accordance with the present disclosure.
In a mobile device, due to limitations in screen size and interactivity, it is difficult to achieve an ideal state for adjusting video playback progress. In particular, the advance and the retreat of the video are currently generally controlled based on the play progress bar, but in the mobile device, it is difficult to accurately adjust the play progress by means of the gesture sliding of the progress bar due to the limitation of the screen size and the limitation of the length of the progress bar or the like. In addition, sometimes, in order to adjust to the scenario or playing time point of interest, the user may need to adjust back and forth multiple times, which is not beneficial to improving the content browsing experience of the user.
Accordingly, according to an embodiment of the present disclosure, there is provided a method 200 for adjusting video playing progress, as shown in fig. 2, including: acquiring a first number of subtitles corresponding to the video and first playing time corresponding to the first number of subtitles in the video respectively (step 210); responding to a first trigger operation for adjusting the video playing progress, and determining a second playing time corresponding to the first trigger operation (step 220); acquiring a second number of subtitles associated with a second play time from the first number of subtitles based on the first play time, wherein the second number is less than or equal to the first number (step 230); and adjusting a playback progress of the video to a first playback time corresponding to the first subtitle in response to a second trigger operation for the first subtitle in the second number of subtitles, the first subtitle being any one of the second number of subtitles (step 240).
According to the embodiment of the disclosure, the playing progress of the video can be accurately adjusted based on the subtitles, so that a user is helped to reduce unnecessary operations, the repeated watching time is saved, and the video watching efficiency and experience of the user are improved.
It will be appreciated that the first number may have a value greater than or equal to 1, the second number may be greater than or equal to 1, and the second number may be less than or equal to the first number.
According to some embodiments, as shown in fig. 3, acquiring the first number of subtitles and the first playing time corresponding to the first number of subtitles respectively may include: framing the video to obtain each extracted frame of picture (step 310); text identifying the picture to identify a picture containing any one of the first number of subtitles (step 320); and determining a first play time corresponding to each of the first number of subtitles based on the video frame corresponding to the picture (step 330).
By way of example, extraction of caption information in a video and association of progress information of the video may be achieved based on OCR (Optical Character Recognition ) technology.
In some examples, the video may be framed every predetermined time period to obtain a picture corresponding to the video frame. Text recognition may be performed on the obtained pictures to identify all pictures containing subtitles, with the identified subtitles as the first number of subtitles. Or further, the identified subtitles may be screened to obtain subtitles meeting a preset condition or content, as the first number of subtitles. For example, the identified subtitles may be filtered to obtain subtitles having a number of words greater than 5 words.
It should be understood that other methods of screening the identified subtitles are possible and are not limited in this regard.
According to some embodiments, as shown in fig. 4, acquiring the first number of subtitles and the first playing time corresponding to the first number of subtitles respectively may include: acquiring audio data corresponding to the video (step 410); performing speech recognition on the audio data to identify a first number of subtitles (step 420); and determining a first play time corresponding to each of the first number of subtitles in the audio data (step 430).
In some examples, the sound audio may be converted to text by speech recognition to enable extraction of subtitle information in the video and the identified subtitles as the first number of subtitles. Or further, the identified subtitles may be screened to obtain subtitles meeting a preset condition or content, as the first number of subtitles. And, the time information of the subtitle may be determined based on the play time corresponding to the subtitle in the audio data.
According to some embodiments, a subtitle file associated with the video, such as a file in ". Ssa", ". Ass" format, etc., may also be directly acquired to acquire a corresponding subtitle and its corresponding play time based on the acquired subtitle file.
It should be understood that other methods for obtaining the subtitle corresponding to the video and the corresponding playing time are possible, and are not limited herein.
According to some embodiments, the first play time may be a subtitle start time. That is, after the playing progress of the video is adjusted to the first playing time corresponding to the subtitle, the video may be played from the starting time of the subtitle to completely play the subtitle. Therefore, the situation that the caption is not played completely in the video advancing or backing process can be prevented, so that the user can obtain the part of scenario or content more completely, and the time for the user to watch repeatedly is saved.
In an embodiment of subtitle data obtained based on speech recognition of audio data, for example, recognition of a subtitle "please ask here XX company" in between 2 minutes 30 seconds and 2 minutes 34 seconds of the audio, then 2 minutes 30 seconds may be taken as the first play time of the subtitle.
In the above embodiment of obtaining the corresponding subtitles by framing the video, determining the first playing time corresponding to each subtitle may include: and responding to the plurality of pictures containing the same subtitle, and taking the earliest time in the video frames corresponding to the plurality of pictures as the first playing time of the subtitle. For example, 5 pictures contain the same subtitle "please refer to XX company here," and a picture with the earliest playing time is determined based on a video frame corresponding to each picture, so that the playing time corresponding to the picture is taken as the playing time of the subtitle.
After the related subtitle and the playing time thereof are obtained, the playing progress of the video can be further refined based on the subtitle.
According to some embodiments, the first trigger operation comprises any one of the group consisting of: a sliding operation on a video playing interface, a clicking operation on a video progress bar, etc. For example, determining the second play time corresponding to the first trigger operation may include: and responding to the first trigger operation, determining the playing progress of the video corresponding to the first trigger operation, and taking the time corresponding to the playing progress as the second playing time.
In some examples, the first trigger operation may be a sliding operation on a video playback interface. For example, a preset sliding gesture performed on the video playing interface may be monitored, so as to first adjust the video playing progress based on a motion parameter value corresponding to the preset sliding gesture, where the motion parameter value may include one or more of a sliding direction, a sliding number, a sliding speed, a sliding distance, and the like. The video playing progress can be adjusted to be forward or backward according to the motion parameters corresponding to the preset sliding gesture, and the playing time corresponding to the sliding operation is further determined to be the second playing time corresponding to the sliding operation.
Then, a second number of subtitles associated with the second play time may be acquired based on time information (first play time) corresponding to the subtitles to fine tune a play progress of the video based further on the subtitles.
In some examples, the user may also click at any play time point of the video progress bar to adjust to the vicinity of what he wants to see. The playing time point clicked by the user on the progress bar is the second playing time corresponding to the operation.
According to some embodiments, the triggering operation may further include: triggering operations on a predetermined area of the video playback terminal or video playback interface. For example, a certain button of the video playing terminal or a predetermined operation (such as a long press, click, etc.) on the video playing mountain may be used as an entry to obtain the current playing progress. Therefore, determining the second play time corresponding to the first trigger operation may include: and responding to the first triggering operation, and determining the time corresponding to the current playing progress of the video as the second playing time.
According to some embodiments, obtaining a second number of subtitles associated with a second play time based on the first play time may comprise: based on the first play time corresponding to the caption determined above, captions within a predetermined time range from the second play time are determined as a second number of captions associated with the second play time. For example, subtitles within a predetermined period (for example, 10 seconds) before and after the second play time point may be acquired.
In some examples, the second number of subtitles associated with the second play time may be presented in a sliding list for further selection by the user of a subtitle. It will of course be appreciated that any other method by which the associated subtitles may be presented is possible, and is not limited in this regard.
Fig. 5 shows a schematic diagram of adjusting a playback progress based on subtitles. As shown in fig. 5, a video may be displayed on a video playback interface 501, where the video may include a progress bar 502. The user may perform a first trigger operation to adjust the progress bar, such as sliding the progress bar 502, etc. After the progress bar is slid to the progress x, a caption n corresponding to the current progress x, a number of captions before and after the current progress x, that is, a caption n+1, a caption n+2, a caption n-2 …, may be displayed in the form of a list 503. When a user selects one of the displayed subtitles through the video playing interface, for example, the subtitle n+2, the video playing progress jumps from the current playing progress to the playing time corresponding to the subtitle n+2.
According to some embodiments, obtaining a second number of subtitles associated with a second play time based on the first play time may comprise: a predetermined number of subtitles closest to the second play time is acquired based on the first play time as a second number of subtitles associated with the second play time. For example, a predetermined number of subtitles before and after the second play time point (for example, the first 5 subtitles and the last 5 subtitles of the current play point) may be acquired.
According to the method, the video playing progress can be accurately adjusted when the user does not know the subtitle content in advance, so that a sliding progress bar which is used for adjusting to a certain playing progress and is repeated for a plurality of times is avoided to a certain extent, unnecessary operation and repeated watching time are saved for the user, and the method is particularly effective in some scenes such as online education and the like; therefore, the efficiency and experience of watching the video by the user are improved.
There is further provided, according to an embodiment of the present disclosure, an apparatus 600 for adjusting video playing progress, as shown in fig. 6, including: a first obtaining unit 610 configured to obtain a first number of subtitles corresponding to the video and a first playing time corresponding to the first number of subtitles in the video; a determining unit 620, configured to determine, in response to a first trigger operation for adjusting the video playing progress, a second playing time corresponding to the first trigger operation; a second obtaining unit 630 configured to obtain, based on the first playing time, a second number of subtitles associated with the second playing time from among the first number of subtitles, wherein the second number is smaller than or equal to the first number; and a play progress adjustment unit 640 configured to adjust a play progress of the video to a first play time corresponding to a first subtitle in response to a second trigger operation for the first subtitle in the second number of subtitles, the first subtitle being any one of the second number of subtitles.
Here, the operations of the above units 610 to 640 of the adjustment 600 of the video playing progress are similar to the operations of the steps 210 to 240 described above, respectively, and are not repeated here.
According to embodiments of the present disclosure, there is also provided an electronic device, a readable storage medium and a computer program product.
Referring to fig. 7, a block diagram of an electronic device 700 that may be a server or a client of the present disclosure, which is an example of a hardware device that may be applied to aspects of the present disclosure, will now be described. Electronic devices are intended to represent various forms of digital electronic computer devices, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 7, the apparatus 700 includes a computing unit 701 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 702 or a computer program loaded from a storage unit 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 may also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.
Various components in device 700 are connected to I/O interface 705, including: an input unit 706, an output unit 707, a storage unit 708, and a communication unit 709. The input unit 706 may be any type of device capable of inputting information to the device 700, the input unit 706 may receive input numeric or character information and generate key signal inputs related to user settings and/or function control of the electronic device, and may include, but is not limited to, a mouse, a keyboard, a touch screen, a trackpad, a trackball, a joystick, a microphone, and/or a remote control. The output unit 707 may be any type of device capable of presenting information and may include, but is not limited to, a display, speakers, video/audio output terminals, vibrators, and/or printers. Storage unit 708 may include, but is not limited to, magnetic disks, optical disks. The communication unit 709 allows the device 700 to exchange information/data with other devices through computer networks, such as the internet, and/or various telecommunications networks, and may include, but is not limited to, modems, network cards, infrared communication devices, wireless communication transceivers and/or chipsets, such as bluetooth (TM) devices, 1302.11 devices, wiFi devices, wiMax devices, cellular communication devices, and/or the like.
The computing unit 701 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 701 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 701 performs the various methods and processes described above, such as method 200. For example, in some embodiments, the method 200 may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 708. In some embodiments, part or all of the computer program may be loaded and/or installed onto device 700 via ROM 702 and/or communication unit 709. One or more of the steps of the method 200 described above may be performed when a computer program is loaded into RAM 703 and executed by the computing unit 701. Alternatively, in other embodiments, the computing unit 701 may be configured to perform the method 200 by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel, sequentially or in a different order, provided that the desired results of the disclosed aspects are achieved, and are not limited herein.
Although embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it is to be understood that the foregoing methods, systems, and apparatus are merely exemplary embodiments or examples, and that the scope of the present invention is not limited by these embodiments or examples but only by the claims following the grant and their equivalents. Various elements of the embodiments or examples may be omitted or replaced with equivalent elements thereof. Furthermore, the steps may be performed in a different order than described in the present disclosure. Further, various elements of the embodiments or examples may be combined in various ways. It is important that as technology evolves, many of the elements described herein may be replaced by equivalent elements that appear after the disclosure.
Claims (17)
1. A method for adjusting video playing progress comprises the following steps:
acquiring a first number of subtitles corresponding to the video and first playing time corresponding to the first number of subtitles in the video respectively, wherein the first playing time comprises a subtitle starting time;
responding to a first trigger operation for adjusting the video playing progress, and determining a second playing time corresponding to the first trigger operation;
acquiring a second number of subtitles associated with the second play time from the first number of subtitles based on the first play time, wherein the second number is less than or equal to the first number; and
and responding to a second triggering operation for a first subtitle in the second number of subtitles, and adjusting the playing progress of the video to a first playing time corresponding to the first subtitle, wherein the first subtitle is any subtitle in the second number of subtitles.
2. The method of claim 1, wherein obtaining the first number of subtitles and a first play time corresponding to the first number of subtitles respectively comprises:
taking frames from the video to obtain each extracted frame of picture;
text recognition is carried out on the pictures so as to identify the pictures containing any caption in the first number of captions; and
and determining a first playing time corresponding to each caption in the first number of captions based on the video frame corresponding to the picture.
3. The method of claim 1, wherein obtaining the first number of subtitles and a first play time corresponding to the first number of subtitles respectively comprises:
acquiring audio data corresponding to the video;
performing voice recognition on the audio data to identify the first number of subtitles; and
and determining a first playing time corresponding to each caption in the first number of captions in the audio data.
4. The method of claim 2, wherein the first playback time comprises a subtitle start time,
the determining the first playing time corresponding to each caption comprises the following steps: and responding to the plurality of pictures containing the same subtitle, and taking the earliest time in the video frames corresponding to the plurality of pictures as the first playing time of the subtitle.
5. The method of any of claims 1-4, wherein the first trigger operation comprises any one of the group consisting of: a sliding operation on the video playing interface, a clicking operation on the video progress bar,
wherein determining the second playing time corresponding to the first triggering operation includes:
and responding to the first trigger operation, determining the playing progress of the video corresponding to the first trigger operation, and taking the time corresponding to the playing progress as the second playing time.
6. The method of any of claims 1-4, wherein the triggering operation comprises: a triggering operation on a predetermined area of the video playback terminal or the video playback interface,
wherein determining the second playing time corresponding to the first triggering operation includes:
and responding to the first triggering operation, and determining the time corresponding to the current playing progress of the video as the second playing time.
7. The method of any of claims 1-4, wherein obtaining a second number of subtitles associated with the second play time based on the first play time comprises:
based on the first play time, subtitles that are within a predetermined time range from the second play time are determined as a second number of subtitles associated with the second play time.
8. The method of any of claims 1-4, wherein obtaining a second number of subtitles associated with the second play time based on the first play time comprises:
and acquiring a predetermined number of subtitles closest to the second playing time based on the first playing time as a second number of subtitles associated with the second playing time.
9. An adjusting device for video playing progress, comprising:
a first obtaining unit configured to obtain a first number of subtitles corresponding to the video and first playing times respectively corresponding to the first number of subtitles in the video, wherein the first playing times include a subtitle start time;
the determining unit is configured to respond to a first trigger operation for adjusting the video playing progress and determine a second playing time corresponding to the first trigger operation;
a second acquisition unit configured to acquire a second number of subtitles associated with the second play time from among the first number of subtitles based on the first play time, wherein the second number is smaller than or equal to the first number; and
and the play progress adjusting unit is configured to respond to a second triggering operation for a first subtitle in the second number of subtitles, and adjust the play progress of the video to a first play time corresponding to the first subtitle, wherein the first subtitle is any subtitle in the second number of subtitles.
10. The apparatus of claim 9, wherein the first acquisition unit comprises:
a unit for framing the video to obtain each extracted frame of picture;
a unit for text recognition of the picture to identify a picture containing any one of the first number of subtitles; and
and determining a first playing time corresponding to each caption in the first number of captions based on the video frame corresponding to the picture.
11. The apparatus of claim 9, wherein the first acquisition unit comprises:
a unit for acquiring audio data corresponding to the video;
means for speech recognition of the audio data to identify the first number of subtitles; and
and means for determining a first play time corresponding to each of the first number of subtitles in the audio data.
12. The apparatus of any of claims 9-11, wherein the first trigger operation comprises any one of the group consisting of: a sliding operation on the video playing interface, a clicking operation on the video progress bar,
wherein the determining unit includes:
and means for determining, in response to the first trigger operation, a play progress of the video corresponding to the first trigger operation, with a time corresponding to the play progress as the second play time.
13. The apparatus of any of claims 9-11, wherein the triggering operation comprises: a triggering operation on a predetermined area of the video playback terminal or the video playback interface,
wherein the determining unit includes:
and the unit is used for responding to the first triggering operation and determining the time corresponding to the current playing progress of the video as the second playing time.
14. The apparatus of any of claims 9-11, wherein the second acquisition unit comprises:
and means for determining, based on the first play time, subtitles that are within a predetermined time range from the second play time as a second number of subtitles associated with the second play time.
15. The apparatus of any of claims 9-11, wherein the second acquisition unit comprises:
and means for acquiring, based on the first play time, a predetermined number of subtitles closest to the second play time as a second number of subtitles associated with the second play time.
16. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the method comprises the steps of
The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-8.
17. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110721630.8A CN113378001B (en) | 2021-06-28 | 2021-06-28 | Video playing progress adjusting method and device, electronic equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110721630.8A CN113378001B (en) | 2021-06-28 | 2021-06-28 | Video playing progress adjusting method and device, electronic equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113378001A CN113378001A (en) | 2021-09-10 |
| CN113378001B true CN113378001B (en) | 2024-02-27 |
Family
ID=77579529
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110721630.8A Active CN113378001B (en) | 2021-06-28 | 2021-06-28 | Video playing progress adjusting method and device, electronic equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113378001B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103458321A (en) * | 2012-06-04 | 2013-12-18 | 联想(北京)有限公司 | Method and device for loading subtitles |
| CN104301771A (en) * | 2013-07-15 | 2015-01-21 | 中兴通讯股份有限公司 | Method and device for adjusting playing progress of video file |
| CN104967910A (en) * | 2014-10-29 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Multimedia play progress control method and apparatus |
| CN105141979A (en) * | 2015-08-21 | 2015-12-09 | 努比亚技术有限公司 | Video subtitle matching device, system and method |
| CN106792071A (en) * | 2016-12-19 | 2017-05-31 | 北京小米移动软件有限公司 | Method for processing caption and device |
| CN109246472A (en) * | 2018-08-01 | 2019-01-18 | 平安科技（深圳）有限公司 | Video broadcasting method, device, terminal device and storage medium |
| CN111988663A (en) * | 2020-08-28 | 2020-11-24 | 北京百度网讯科技有限公司 | Method, device and equipment for positioning video playing node and storage medium |
| CN112752047A (en) * | 2019-10-30 | 2021-05-04 | 北京小米移动软件有限公司 | Video recording method, device, equipment and readable storage medium |
| WO2021092733A1 (en) * | 2019-11-11 | 2021-05-20 | 深圳市欢太科技有限公司 | Subtitle display method and apparatus, electronic device and storage medium |
-
2021
- 2021-06-28 CN CN202110721630.8A patent/CN113378001B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103458321A (en) * | 2012-06-04 | 2013-12-18 | 联想(北京)有限公司 | Method and device for loading subtitles |
| CN104301771A (en) * | 2013-07-15 | 2015-01-21 | 中兴通讯股份有限公司 | Method and device for adjusting playing progress of video file |
| CN104967910A (en) * | 2014-10-29 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Multimedia play progress control method and apparatus |
| CN105141979A (en) * | 2015-08-21 | 2015-12-09 | 努比亚技术有限公司 | Video subtitle matching device, system and method |
| CN106792071A (en) * | 2016-12-19 | 2017-05-31 | 北京小米移动软件有限公司 | Method for processing caption and device |
| CN109246472A (en) * | 2018-08-01 | 2019-01-18 | 平安科技（深圳）有限公司 | Video broadcasting method, device, terminal device and storage medium |
| CN112752047A (en) * | 2019-10-30 | 2021-05-04 | 北京小米移动软件有限公司 | Video recording method, device, equipment and readable storage medium |
| EP3817395A1 (en) * | 2019-10-30 | 2021-05-05 | Beijing Xiaomi Mobile Software Co., Ltd. | Video recording method and apparatus, device, and readable storage medium |
| WO2021092733A1 (en) * | 2019-11-11 | 2021-05-20 | 深圳市欢太科技有限公司 | Subtitle display method and apparatus, electronic device and storage medium |
| CN111988663A (en) * | 2020-08-28 | 2020-11-24 | 北京百度网讯科技有限公司 | Method, device and equipment for positioning video playing node and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 陈文华 ; .远程教育中视频同步字幕的制作方法研究.福建电脑.2010,(第07期),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113378001A (en) | 2021-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113194350B (en) | Method and device for pushing data to be broadcasted and method and device for broadcasting data | |
| CN112836072B (en) | Information display method and device, electronic equipment and medium | |
| WO2023273562A1 (en) | Video playback method and apparatus, electronic device, and medium | |
| CN113313650A (en) | Image quality enhancement method, device, equipment and medium | |
| CN112887749A (en) | Method and device for providing live content preview, electronic equipment and medium | |
| CN113810773B (en) | Video downloading method and device, electronic equipment and storage medium | |
| CN113378001B (en) | Video playing progress adjusting method and device, electronic equipment and medium | |
| CN114245171B (en) | Video editing method and device, electronic equipment and medium | |
| CN113722628B (en) | Method, apparatus, device and medium for displaying information stream | |
| CN114510308B (en) | Method, device, equipment and medium for storing application page by mobile terminal | |
| CN113436604B (en) | Method and device for broadcasting content, electronic equipment and storage medium | |
| CN114359017B (en) | Multimedia resource processing method and device and electronic equipment | |
| CN113312511B (en) | Method, apparatus, device and computer readable storage medium for recommending content | |
| CN114880580A (en) | Information recommendation method and device, electronic equipment and medium | |
| CN113891121A (en) | Video subtitle processing method, video subtitle display method and device | |
| CN112558915A (en) | Voice broadcasting method and device, electronic equipment, medium and product | |
| CN113139093A (en) | Video search method and apparatus, computer device, and medium | |
| CN113556649A (en) | Broadcasting control method and device of intelligent sound box | |
| CN113190695B (en) | Multimedia data searching method and device, computer equipment and medium | |
| CN113126865B (en) | Note generation method and device in video learning process, electronic equipment and medium | |
| CN113722534B (en) | Video recommendation method and device | |
| CN113139094B (en) | Video searching method and device, electronic equipment and medium | |
| CN113382310B (en) | Information recommendation method and device, electronic equipment and medium | |
| CN115170536B (en) | Image detection method, training method and device of model | |
| CN114510187B (en) | Image display method and device, electronic equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |