CN113378001A

CN113378001A - Video playing progress adjusting method and device, electronic equipment and medium

Info

Publication number: CN113378001A
Application number: CN202110721630.8A
Authority: CN
Inventors: 刘俊启
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2021-06-28
Filing date: 2021-06-28
Publication date: 2021-09-10
Anticipated expiration: 2041-06-28
Also published as: CN113378001B

Abstract

The disclosure provides a method and a device for adjusting video playing progress, electronic equipment, a computer readable storage medium and a computer program product, and relates to the field of computers, in particular to the technical field of video terminals. The implementation scheme is as follows: acquiring a first number of subtitles corresponding to a video and first playing time corresponding to the subtitles in the first number in the video respectively; responding to a first trigger operation for adjusting the video playing progress, and determining a second playing time corresponding to the first trigger operation; acquiring a second number of subtitles associated with a second playing time from the first number of subtitles based on the first playing time, wherein the second number is less than or equal to the first number; and responding to a second trigger operation aiming at a first subtitle in the second amount of subtitles, and adjusting the playing progress of the video to a first playing time corresponding to the first subtitle, wherein the first subtitle is any one subtitle in the second amount of subtitles.

Description

Video playing progress adjusting method and device, electronic equipment and medium

Technical Field

The present disclosure relates to the field of computers, and in particular, to the field of video terminal technologies, and in particular, to a method and an apparatus for adjusting a video playing progress, an electronic device, a computer-readable storage medium, and a computer program product.

Background

With the popularization of the mobile internet, people use mobile phones to surf the internet becomes a normal state, and with the construction of the mobile network, the high-speed and stable mobile network makes it possible for users to check high-quality contents under the mobile network.

In the process of watching a video, a user may need to adjust the playing progress of the video to meet different watching requirements of the user. Currently, the progress bar is generally adjusted to advance and retreat by a gesture-based sliding motion. However, generally, the screen of the video playing device may be small, the length of the progress bar is limited, and the user may need to slide the progress bar back and forth for multiple times in order to adjust the playing position in which the user is interested, so that the accuracy is hard to be ensured, and the content browsing experience of the user is not facilitated.

Disclosure of Invention

The disclosure provides a method and a device for adjusting video playing progress, electronic equipment, a computer readable storage medium and a computer program product.

According to an aspect of the present disclosure, a method for adjusting a video playing progress is provided, including: acquiring a first number of subtitles corresponding to the video and first playing time corresponding to the subtitles of the first number in the video respectively; responding to a first trigger operation for adjusting the video playing progress, and determining a second playing time corresponding to the first trigger operation; obtaining a second number of subtitles associated with the second play time from the first number of subtitles based on the first play time, wherein the second number is less than or equal to the first number; and responding to a second trigger operation aiming at a first subtitle in the second amount of subtitles, and adjusting the playing progress of the video to a first playing time corresponding to the first subtitle, wherein the first subtitle is any one subtitle in the second amount of subtitles.

According to another aspect of the present disclosure, there is provided an apparatus for adjusting a video playing progress, including: a first obtaining unit configured to obtain a first number of subtitles corresponding to the video and first playing times respectively corresponding to the first number of subtitles in the video; the determining unit is configured to respond to a first trigger operation for adjusting the video playing progress, and determine a second playing time corresponding to the first trigger operation; a second obtaining unit configured to obtain a second number of subtitles associated with the second play time from the first number of subtitles based on the first play time, wherein the second number is less than or equal to the first number; and the playing progress adjusting unit is configured to respond to a second trigger operation aiming at a first subtitle in the second number of subtitles, and adjust the playing progress of the video to a first playing time corresponding to the first subtitle, wherein the first subtitle is any one subtitle in the second number of subtitles.

According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the method of the present disclosure.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method described in the present disclosure.

According to another aspect of the disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the method described in the disclosure.

According to one or more embodiments of the present disclosure, the playing progress of a video can be accurately adjusted based on subtitles, which helps a user reduce unnecessary operations and save time for repeated watching, and improves efficiency and experience of the user in watching the video.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the embodiments and, together with the description, serve to explain the exemplary implementations of the embodiments. The illustrated embodiments are for purposes of illustration only and do not limit the scope of the claims. Throughout the drawings, identical reference numbers designate similar, but not necessarily identical, elements.

FIG. 1 illustrates a schematic diagram of an exemplary system in which various methods described herein may be implemented, according to an embodiment of the present disclosure;

fig. 2 shows a flowchart of an adjustment method of a video playing progress according to an embodiment of the present disclosure;

fig. 3 shows a flowchart for obtaining subtitles and their corresponding play times according to an embodiment of the present disclosure;

fig. 4 shows a flowchart for obtaining subtitles and their corresponding play times according to another embodiment of the present disclosure;

fig. 5 illustrates a schematic diagram of adjusting a play progress based on subtitles according to an embodiment of the present disclosure;

fig. 6 is a block diagram illustrating a configuration of an apparatus for adjusting a video playing progress according to an embodiment of the present disclosure; and

FIG. 7 illustrates a block diagram of an exemplary electronic device that can be used to implement embodiments of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In the present disclosure, unless otherwise specified, the use of the terms "first", "second", etc. to describe various elements is not intended to limit the positional relationship, the timing relationship, or the importance relationship of the elements, and such terms are used only to distinguish one element from another. In some examples, a first element and a second element may refer to the same instance of the element, and in some cases, based on the context, they may also refer to different instances.

The terminology used in the description of the various described examples in this disclosure is for the purpose of describing particular examples only and is not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, the elements may be one or more. Furthermore, the term "and/or" as used in this disclosure is intended to encompass any and all possible combinations of the listed items.

Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

Fig. 1 illustrates a schematic diagram of an exemplary system 100 in which various methods and apparatus described herein may be implemented in accordance with embodiments of the present disclosure. Referring to fig. 1, the system 100 includes one or

more client devices

101, 102, 103, 104, 105, and 106, a server 120, and one or more communication networks 110 coupling the one or more client devices to the server 120.

Client devices

101, 102, 103, 104, 105, and 106 may be configured to execute one or more applications.

In embodiments of the present disclosure, the server 120 may run one or more services or software applications that enable the execution of the adjustment method of the video playing progress.

In some embodiments, the server 120 may also provide other services or software applications that may include non-virtual environments and virtual environments. In certain embodiments, these services may be provided as web-based services or cloud services, for example, provided to users of

client devices

101, 102, 103, 104, 105, and/or 106 under a software as a service (SaaS) model.

In the configuration shown in fig. 1, server 120 may include one or more components that implement the functions performed by server 120. These components may include software components, hardware components, or a combination thereof, which may be executed by one or more processors. A user operating a

client device

101, 102, 103, 104, 105, and/or 106 may, in turn, utilize one or more client applications to interact with the server 120 to take advantage of the services provided by these components. It should be understood that a variety of different system configurations are possible, which may differ from system 100. Accordingly, fig. 1 is one example of a system for implementing the various methods described herein and is not intended to be limiting.

The user may use the

client devices

101, 102, 103, 104, 105, and/or 106 to play videos, adjust video playback schedules, and so on. The client device may provide an interface that enables a user of the client device to interact with the client device. The client device may also output information to the user via the interface. Although fig. 1 depicts only six client devices, those skilled in the art will appreciate that any number of client devices may be supported by the present disclosure.

Client devices

101, 102, 103, 104, 105, and/or 106 may include various types of computer devices, such as portable handheld devices, general purpose computers (such as personal computers and laptop computers), workstation computers, wearable devices, gaming systems, thin clients, various messaging devices, sensors or other sensing devices, and so forth. These computer devices may run various types and versions of software applications and operating systems, such as MICROSOFT Windows, APPLE iOS, UNIX-like operating systems, Linux, or Linux-like operating systems (e.g., Google Chrome OS); or include various Mobile operating systems such as MICROSOFT Windows Mobile OS, iOS, Windows Phone, Android. Portable handheld devices may include cellular telephones, smart phones, tablets, Personal Digital Assistants (PDAs), and the like. Wearable devices may include head mounted displays and other devices. The gaming system may include a variety of handheld gaming devices, internet-enabled gaming devices, and the like. The client device is capable of executing a variety of different applications, such as various Internet-related applications, communication applications (e.g., email applications), Short Message Service (SMS) applications, and may use a variety of communication protocols.

Network 110 may be any type of network known to those skilled in the art that may support data communications using any of a variety of available protocols, including but not limited to TCP/IP, SNA, IPX, etc. By way of example only, one or more networks 110 may be a Local Area Network (LAN), an ethernet-based network, a token ring, a Wide Area Network (WAN), the internet, a virtual network, a Virtual Private Network (VPN), an intranet, an extranet, a Public Switched Telephone Network (PSTN), an infrared network, a wireless network (e.g., bluetooth, WIFI), and/or any combination of these and/or other networks.

The server 120 may include one or more general purpose computers, special purpose server computers (e.g., PC (personal computer) servers, UNIX servers, mid-end servers), blade servers, mainframe computers, server clusters, or any other suitable arrangement and/or combination. The server 120 may include one or more virtual machines running a virtual operating system, or other computing architecture involving virtualization (e.g., one or more flexible pools of logical storage that may be virtualized to maintain virtual storage for the server). In various embodiments, the server 120 may run one or more services or software applications that provide the functionality described below.

The computing units in server 120 may run one or more operating systems including any of the operating systems described above, as well as any commercially available server operating systems. The server 120 may also run any of a variety of additional server applications and/or middle tier applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, and the like.

In some implementations, the server 120 may include one or more applications to analyze and consolidate data feeds and/or event updates received from users of the

client devices

101, 102, 103, 104, 105, and 106. Server 120 may also include one or more applications to display data feeds and/or real-time events via one or more display devices of

client devices

101, 102, 103, 104, 105, and 106.

In some embodiments, the server 120 may be a server of a distributed system, or a server incorporating a blockchain. The server 120 may also be a cloud server, or a smart cloud computing server or a smart cloud host with artificial intelligence technology. The cloud Server is a host product in a cloud computing service system, and is used for solving the defects of high management difficulty and weak service expansibility in the traditional physical host and Virtual Private Server (VPS) service.

The system 100 may also include one or more databases 130. In some embodiments, these databases may be used to store data and other information. For example, one or more of the databases 130 may be used to store data such as video, subtitles, and the like. The data store 130 may reside in various locations. For example, the data store used by the server 120 may be local to the server 120, or may be remote from the server 120 and may communicate with the server 120 via a network-based or dedicated connection. The data store 130 may be of different types. In certain embodiments, the data store used by the server 120 may be a database, such as a relational database. One or more of these databases may store, update, and retrieve data to and from the database in response to the command.

In some embodiments, one or more of the databases 130 may also be used by applications to store application data. The databases used by the application may be different types of databases, such as key-value stores, object stores, or regular stores supported by a file system.

The system 100 of fig. 1 may be configured and operated in various ways to enable application of the various methods and apparatus described in accordance with the present disclosure.

In a mobile device, due to the limitation of the screen size and the interactive mode, the adjustment of the video playing progress is difficult to reach an ideal state. Specifically, the progress and retreat of a video are generally controlled based on a play progress bar at present, but in a mobile device, due to the limitation of the screen size and the limitation of the length of the progress bar, the adjustment of the play progress by sliding the progress bar through a gesture is difficult to be accurately performed. Moreover, sometimes, in order to adjust to a scenario or a playing time point that the user is interested in, the user may need to adjust back and forth many times, which is not favorable for improving the content browsing experience of the user.

Therefore, an adjusting method 200 of a video playing progress is provided according to an embodiment of the present disclosure, as shown in fig. 2, including: acquiring a first number of subtitles corresponding to a video and first playing time respectively corresponding to the subtitles of the first number in the video (step 210); responding to a first trigger operation for adjusting the video playing progress, and determining a second playing time corresponding to the first trigger operation (step 220); obtaining a second number of subtitles associated with a second play time from the first number of subtitles based on the first play time, wherein the second number is less than or equal to the first number (step 230); and responding to a second trigger operation aiming at a first subtitle in the second number of subtitles, and adjusting the playing progress of the video to a first playing time corresponding to the first subtitle, wherein the first subtitle is any one subtitle in the second number of subtitles (step 240).

According to the embodiment of the disclosure, the playing progress of the video can be accurately adjusted based on the subtitles, so that the user is helped to reduce unnecessary operations and save repeated watching time, and the efficiency and experience of watching the video by the user are improved.

It is understood that the first number has a value greater than or equal to 1 and the second number may also be greater than or equal to 1, the second number being less than or equal to the first number.

According to some embodiments, as shown in fig. 3, the obtaining the first number of subtitles and the first playing time corresponding to the first number of subtitles may include: framing the video to obtain each extracted frame picture (step 310); performing text recognition on the picture to recognize the picture containing any one subtitle in the first number of subtitles (step 320); and determining a first playing time corresponding to each subtitle in the first number of subtitles based on the video frame corresponding to the picture (step 330).

Illustratively, extracting subtitle information in a video and associating progress information of the video may be implemented based on an OCR (Optical Character Recognition) technology.

In some examples, a video may be framed every predetermined period of time to obtain pictures corresponding to the video frames. Text recognition may be performed on the obtained pictures to recognize all the pictures containing subtitles, so as to take the recognized subtitles as the first number of subtitles. Or, further, the identified subtitles may be filtered to obtain subtitles meeting a preset condition or content as the subtitles of the first number. For example, the identified subtitles may be filtered to obtain subtitles with a word count greater than 5 words.

It should be understood that other methods of filtering the identified subtitles are possible and are not limited herein.

According to some embodiments, as shown in fig. 4, the obtaining the first number of subtitles and the first playing time corresponding to the first number of subtitles may include: acquiring audio data corresponding to the video (step 410); performing voice recognition on the audio data to recognize a first number of subtitles (step 420); and determining a first playing time corresponding to each subtitle in the first number of subtitles in the audio data (step 430).

In some examples, the audio may be converted to text by speech recognition to enable extraction of caption information in the video, and the identified captions may be the first number of captions. Or, further, the identified subtitles may be filtered to obtain subtitles meeting a preset condition or content as the subtitles of the first number. And, the time information of the subtitle may be determined based on the playing time of the subtitle corresponding to the audio data.

According to some embodiments, a subtitle file associated with the video, such as a file in the format of ". ssa", ". ass", or the like, may also be directly acquired, so as to acquire a corresponding subtitle and its corresponding playing time based on the acquired subtitle file.

It should be understood that other methods that can be used to obtain the subtitles and the playing time corresponding to the video are also possible, and are not limited herein.

According to some embodiments, the first play time may be a subtitle start time. That is, after the playing progress of the video is adjusted to the first playing time corresponding to the subtitle, the video may be played from the starting time of the subtitle to completely play the subtitle. Therefore, the situation that the captions are not completely played in the process of advancing or retreating the video can be prevented, so that the user can more completely acquire the part of the plot or the content, and the time for the user to repeatedly watch the plot or the content is saved.

In the embodiment of the subtitle data obtained based on the voice recognition of the audio data, for example, the subtitle "please ask for the XX company, is recognized between 2 minutes 30 seconds and 2 minutes 34 seconds of the audio, and 2 minutes 30 seconds may be used as the first playing time of the subtitle.

In the above embodiment of obtaining the corresponding subtitles by framing the video, determining the first playing time corresponding to each subtitle may include: and in response to the plurality of pictures containing the same subtitle, taking the earliest time in the video frames corresponding to the plurality of pictures as the first playing time of the subtitle. For example, 5 pictures include the same subtitle, "ask for a question here is XX company", and a picture with the earliest playing time is determined based on the video frame corresponding to each picture, so that the playing time corresponding to the picture is taken as the playing time of the subtitle.

After the related subtitle and the playing time thereof are obtained, the playing progress of the video can be further fine-tuned based on the subtitle.

According to some embodiments, the first trigger operation comprises any one of the group consisting of: a sliding operation on the video playing interface, a clicking operation on the video progress bar, and the like. For example, determining the second playing time corresponding to the first trigger operation may include: and responding to the first trigger operation, determining the playing progress of the video corresponding to the first trigger operation, and taking the time corresponding to the playing progress as the second playing time.

In some examples, the first trigger operation may be a slide operation on a video playback interface. For example, a preset slide gesture performed on the video playing interface may be monitored to first adjust the video playing progress based on a motion parameter value corresponding to the preset slide gesture, where the motion parameter value may include one or more of a slide direction, a slide number, a slide speed, a slide distance, and the like. The video playing progress can be adjusted to be forward or backward according to the motion parameters corresponding to the preset sliding gesture, and the playing time corresponding to the sliding operation is further determined to serve as the second playing time corresponding to the operation.

Then, a second number of subtitles associated with the second playing time may be obtained based on the time information (first playing time) corresponding to the subtitles, so as to fine tune the playing progress of the video based on the subtitles.

In some examples, the user may also click at any playing time point of the video progress bar to adjust to the vicinity of the content that the user wants to see. And the playing time point clicked on the progress bar by the user is the second playing time corresponding to the operation.

According to some embodiments, the triggering operation may further include: and triggering operation on a preset area of the video playing terminal or the video playing interface. For example, a certain button of the video playing terminal or a predetermined operation (e.g., long press, click, etc.) on the video playing boundary hill may be used as an entry to acquire the current playing progress. Therefore, determining the second playing time corresponding to the first trigger operation may include: and responding to the first trigger operation, and determining the time corresponding to the current playing progress of the video as second playing time.

According to some embodiments, obtaining the second number of subtitles associated with the second play time based on the first play time may include: and determining the subtitles within a preset time range from the second playing time based on the first playing time corresponding to the subtitles determined above as a second number of subtitles associated with the second playing time. Illustratively, subtitles within a predetermined time period (e.g., 10 seconds) before and after the second play time point may be acquired.

In some examples, a second number of subtitles associated with the second play time may be presented in a sliding list for further selection of a subtitle by the user. It is understood, of course, that any other method of presenting the associated subtitles is possible and not limited thereto.

Fig. 5 shows a schematic diagram for adjusting the progress of play based on subtitles. As shown in fig. 5, a video may be displayed on a video play interface 501, where the video may contain a progress bar 502. The user may perform a first trigger operation of adjusting the progress bar, such as sliding the progress bar 502, etc. After sliding the progress bar to the progress x, the subtitle n corresponding to the current progress x, and a number of subtitles before and after the current progress x, that is, the subtitle n +1, the subtitle n +2, and the subtitle n-2 … may be displayed in the form of a list 503. When a user selects one of the displayed subtitles, such as the subtitle n +2, through the video playing interface, the video playing progress jumps from the current playing progress to the playing time corresponding to the subtitle n + 2.

According to some embodiments, obtaining the second number of subtitles associated with the second play time based on the first play time may include: and acquiring a preset number of subtitles closest to the second playing time based on the first playing time as a second number of subtitles associated with the second playing time. Illustratively, a predetermined number of subtitles (e.g., 5 subtitles before and 5 subtitles after the current play point) before and after the second play time point may be acquired.

According to the method disclosed by the invention, the video playing progress can be accurately adjusted when the user does not know the subtitle content in advance, so that a plurality of sliding progress bars for adjusting to a certain playing progress are avoided to a certain extent, unnecessary operation and repeated watching time are saved for the user, and the method is particularly effective under the situations such as online education and the like; therefore, the efficiency and experience of watching videos by users are improved.

There is also provided an apparatus 600 for adjusting a video playing progress according to an embodiment of the present disclosure, as shown in fig. 6, including: a first obtaining unit 610 configured to obtain a first number of subtitles corresponding to the video and a first playing time corresponding to the first number of subtitles in the video; the determining unit 620 is configured to determine, in response to a first trigger operation for adjusting the video playing progress, a second playing time corresponding to the first trigger operation; a second obtaining unit 630 configured to obtain a second number of subtitles associated with the second play time from the first number of subtitles based on the first play time, wherein the second number is less than or equal to the first number; and a playing progress adjusting unit 640 configured to adjust the playing progress of the video to a first playing time corresponding to a first subtitle in the second number of subtitles in response to a second trigger operation for the first subtitle, where the first subtitle is any one of the second number of subtitles.

Here, the operations of the units 610 to 640 of the adjustment 600 of the video playing progress are similar to the operations of the steps 210 to 240 described above, and are not described herein again.

According to an embodiment of the present disclosure, there is also provided an electronic device, a readable storage medium, and a computer program product.

Referring to fig. 7, a block diagram of a structure of an electronic device 700, which may be a server or a client of the present disclosure, which is an example of a hardware device that may be applied to aspects of the present disclosure, will now be described. Electronic device is intended to represent various forms of digital electronic computer devices, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 7, the device 700 comprises a computing unit 701, which may perform various suitable actions and processes according to a computer program stored in a Read Only Memory (ROM)702 or a computer program loaded from a storage unit 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 can also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other by a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.

Various components in the device 700 are connected to the I/O interface 705, including: an input unit 706, an output unit 707, a storage unit 708, and a communication unit 709. The input unit 706 may be any type of device capable of inputting information to the device 700, and the input unit 706 may receive input numeric or character information and generate key signal inputs related to user settings and/or function controls of the electronic device, and may include, but is not limited to, a mouse, a keyboard, a touch screen, a track pad, a track ball, a joystick, a microphone, and/or a remote controller. Output unit 707 may be any type of device capable of presenting information and may include, but is not limited to, a display, speakers, a video/audio output terminal, a vibrator, and/or a printer. Storage unit 708 may include, but is not limited to, magnetic or optical disks. The communication unit 709 allows the device 700 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunications networks, and may include, but is not limited to, modems, network cards, infrared communication devices, wireless communication transceivers and/or chipsets, such as bluetooth (TM) devices, 1302.11 devices, WiFi devices, WiMax devices, cellular communication devices, and/or the like.

Computing unit 701 may be a variety of general purpose and/or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The computing unit 701 performs the various methods and processes described above, such as the method 200. For example, in some embodiments, the method 200 may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 708. In some embodiments, part or all of a computer program may be loaded onto and/or installed onto device 700 via ROM 702 and/or communications unit 709. When the computer program is loaded into RAM 703 and executed by the computing unit 701, one or more steps of the method 200 described above may be performed. Alternatively, in other embodiments, the computing unit 701 may be configured to perform the method 200 by any other suitable means (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server with a combined blockchain.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be performed in parallel, sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.

Although embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it is to be understood that the above-described methods, systems and apparatus are merely exemplary embodiments or examples and that the scope of the present invention is not limited by these embodiments or examples, but only by the claims as issued and their equivalents. Various elements in the embodiments or examples may be omitted or may be replaced with equivalents thereof. Further, the steps may be performed in an order different from that described in the present disclosure. Further, various elements in the embodiments or examples may be combined in various ways. It is important that as technology evolves, many of the elements described herein may be replaced with equivalent elements that appear after the present disclosure.

Claims

1. A method for adjusting video playing progress comprises the following steps:

acquiring a first number of subtitles corresponding to the video and first playing time corresponding to the subtitles of the first number in the video respectively;

responding to a first trigger operation for adjusting the video playing progress, and determining a second playing time corresponding to the first trigger operation;

obtaining a second number of subtitles associated with the second play time from the first number of subtitles based on the first play time, wherein the second number is less than or equal to the first number; and

and responding to a second trigger operation aiming at a first subtitle in the second amount of subtitles, and adjusting the playing progress of the video to a first playing time corresponding to the first subtitle, wherein the first subtitle is any one subtitle in the second amount of subtitles.

2. The method of claim 1, wherein obtaining the first number of subtitles and first playing times corresponding to the first number of subtitles comprises:

taking frames of the video to obtain each extracted frame picture;

performing text recognition on the picture to recognize the picture containing any one subtitle in the first number of subtitles; and

and determining a first playing time corresponding to each subtitle in the first number of subtitles based on the video frame corresponding to the picture.

3. The method of claim 1, wherein obtaining the first number of subtitles and first playing times corresponding to the first number of subtitles comprises:

acquiring audio data corresponding to the video;

performing voice recognition on the audio data to recognize the first number of subtitles; and

and determining a first playing time corresponding to each subtitle in the first number of subtitles in the audio data.

4. The method of any of claims 1-3, wherein the first play time comprises a subtitle start time.

5. The method of claim 2, wherein the first play time comprises a subtitle start time,

wherein determining the first playing time corresponding to each subtitle includes: and in response to the fact that the plurality of pictures contain the same subtitle, taking the earliest time in the video frames corresponding to the plurality of pictures as the first playing time of the subtitle.

6. The method of any of claims 1-5, wherein the first trigger operation comprises any one of the group consisting of: a sliding operation on the video playing interface, a clicking operation on the video progress bar,

wherein determining the second playing time corresponding to the first trigger operation comprises:

and responding to the first trigger operation, determining the playing progress of the video corresponding to the first trigger operation, and taking the time corresponding to the playing progress as the second playing time.

7. The method of any of claims 1-5, wherein the triggering operation comprises: a trigger operation on a predetermined area of the video playing terminal or the video playing interface,

and responding to the first trigger operation, and determining the time corresponding to the current playing progress of the video as the second playing time.

8. The method of claims 1-7, wherein retrieving the second number of subtitles associated with the second play time based on the first play time comprises:

and determining the subtitles within a preset time range from the second playing time based on the first playing time as a second number of subtitles associated with the second playing time.

9. The method of claims 1-7, wherein retrieving the second number of subtitles associated with the second play time based on the first play time comprises:

and acquiring a preset number of subtitles closest to the second playing time based on the first playing time to serve as a second number of subtitles associated with the second playing time.

10. An apparatus for adjusting progress of video playing, comprising:

a first obtaining unit configured to obtain a first number of subtitles corresponding to the video and first playing times respectively corresponding to the first number of subtitles in the video;

the determining unit is configured to respond to a first trigger operation for adjusting the video playing progress, and determine a second playing time corresponding to the first trigger operation;

a second obtaining unit configured to obtain a second number of subtitles associated with the second play time from the first number of subtitles based on the first play time, wherein the second number is less than or equal to the first number; and

and the playing progress adjusting unit is configured to adjust the playing progress of the video to a first playing time corresponding to a first subtitle in the second number of subtitles in response to a second trigger operation for the first subtitle, wherein the first subtitle is any one of the second number of subtitles.

11. The apparatus of claim 10, wherein the first obtaining unit comprises:

means for framing the video to obtain each extracted frame picture;

a unit configured to perform text recognition on the picture to recognize a picture including any one of the first number of subtitles; and

means for determining a first playback time corresponding to each of the first number of subtitles based on a video frame corresponding to the picture.

12. The apparatus of claim 10, wherein the first obtaining unit comprises:

means for obtaining audio data corresponding to the video;

means for performing speech recognition on the audio data to identify the first number of subtitles; and

means for determining a first playback time for each of the first number of subtitles in the audio data.

13. The apparatus of any of claims 10-12, wherein the first trigger operation comprises any one of the group consisting of: a sliding operation on the video playing interface, a clicking operation on the video progress bar,

wherein the determination unit includes:

and the unit is used for responding to the first trigger operation, determining the playing progress of the video corresponding to the first trigger operation and taking the time corresponding to the playing progress as the second playing time.

14. The apparatus of any of claims 10-12, wherein the triggering operation comprises: a trigger operation on a predetermined area of the video playing terminal or the video playing interface,

wherein the determination unit includes:

and the unit is used for responding to the first trigger operation and determining the time corresponding to the current playing progress of the video as the second playing time.

15. The apparatus of claims 10-12, wherein the second obtaining unit comprises:

means for determining subtitles within a predetermined time range from the second play time as a second number of subtitles associated with the second play time based on the first play time.

16. The apparatus of claims 10-12, wherein the second obtaining unit comprises:

means for obtaining a predetermined number of subtitles closest to the second play time based on the first play time as a second number of subtitles associated with the second play time.

17. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-9.

18. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-9.

19. A computer program product comprising a computer program, wherein the computer program realizes the method of any one of claims 1-9 when executed by a processor.