CN113507647A - Multimedia data play control method, device, terminal and readable storage medium - Google Patents

Multimedia data play control method, device, terminal and readable storage medium Download PDF

Info

Publication number
CN113507647A
CN113507647A CN202110838601.XA CN202110838601A CN113507647A CN 113507647 A CN113507647 A CN 113507647A CN 202110838601 A CN202110838601 A CN 202110838601A CN 113507647 A CN113507647 A CN 113507647A
Authority
CN
China
Prior art keywords
playing
multimedia data
graph
multimedia
segmented
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110838601.XA
Other languages
Chinese (zh)
Other versions
CN113507647B (en
Inventor
刘春宇
党正军
夏佳权
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Kugou Computer Technology Co Ltd
Original Assignee
Guangzhou Kugou Computer Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Kugou Computer Technology Co Ltd filed Critical Guangzhou Kugou Computer Technology Co Ltd
Priority to CN202110838601.XA priority Critical patent/CN113507647B/en
Publication of CN113507647A publication Critical patent/CN113507647A/en
Application granted granted Critical
Publication of CN113507647B publication Critical patent/CN113507647B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The application provides a playing control method, a playing control device, a terminal and a readable storage medium of multimedia data, and belongs to the technical field of multimedia. The user can draw the graph on the playing interface of the target multimedia data, and then the target multimedia data is played based on the graph drawn by the user in the playing control mode corresponding to the graph, so that the diversity of the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.

Description

Multimedia data play control method, device, terminal and readable storage medium
Technical Field
The present application relates to the field of multimedia technologies, and in particular, to a method, an apparatus, a terminal and a readable storage medium for controlling playing of multimedia data.
Background
With the development of multimedia technology, video playing software also presents diversified development modes. However, the current video playing software only supports three playing control modes of forward playing, reverse playing, and jumping to a corresponding playing position (i.e. Seek operation, or jump operation) by dragging a playing slider on a progress bar, so that the flexibility and intelligence of video playing are poor.
Disclosure of Invention
The embodiment of the application provides a multimedia data playing control method, a multimedia data playing control device, a terminal and a readable storage medium, and can improve the flexibility and intelligence of multimedia data playing. The technical scheme provided by the application is as follows:
in one aspect, a method for controlling playing of multimedia data is provided, the method comprising:
responding to the drawing operation of a playing interface of the target multimedia data, and displaying a graph generated based on the drawing operation;
determining a playing control mode corresponding to the graph;
and playing the target multimedia data based on the playing control mode.
In a possible implementation manner, determining a play control manner corresponding to the graphic includes:
under the condition that the graph is a plurality of segmented graphs, determining the playing control mode as segmented playing;
under the condition that the segmented graphs do not overlap with each other, determining the length proportion of each segmented graph;
segmenting the target multimedia data into a plurality of multimedia segments based on the length proportion of each segmented graph and the playing time length of the target multimedia data;
wherein the segmented graphics comprise rectangles or line segments.
In one possible implementation manner, playing the target multimedia data based on the playing control manner includes:
playing any one of the plurality of multimedia clips on the playing interface, wherein the playing interface comprises a switching control;
and responding to the triggering operation of the switching control, and playing a next multimedia segment corresponding to any one multimedia segment.
In a possible implementation manner, determining a play control manner corresponding to the graphic includes:
under the condition that the graph is a plurality of segmented graphs, determining the playing control mode as segmented playing;
determining the length proportion of each segmented graph under the condition that the segmented graphs intersect;
segmenting the target multimedia data into a plurality of multimedia segments based on the length proportion of each segmented graph and the playing time length of the target multimedia data;
and determining the intersecting position of each segmented graph as the target time in each multimedia segment.
In one possible implementation manner, playing the target multimedia data based on the playing control manner includes:
playing any one of the plurality of multimedia clips on the playing interface, wherein the playing interface comprises a switching control;
and when the target time in any one multimedia segment is played, responding to the trigger operation of the switching control, and starting to play the next multimedia segment from the target time in the next multimedia segment corresponding to any one multimedia segment.
In a possible implementation manner, determining a play control manner corresponding to the graphic includes:
and determining the playing control mode as circular playing under the condition that the graph is a circular ring.
In a possible implementation manner, determining a play control manner corresponding to the graphic includes:
under the condition that the graph is a double-speed graph, determining the playing control mode as double-speed playing;
determining the playing speed of the target multimedia data based on the number of the edges of the speed-doubling graph;
wherein the multiple speed pattern comprises a polygon.
In a possible implementation manner, determining a play control manner corresponding to the graphic includes:
in the case where the graphic is an arrow and the arrow points to the left, the playback control mode is determined to be reverse playback.
In one aspect, there is provided a playback control apparatus for multimedia data, the apparatus including:
the display module is used for responding to the drawing operation on the playing interface of the target multimedia data and displaying the graph generated based on the drawing operation;
the determining module is used for determining a playing control mode corresponding to the graph;
and the playing module is used for playing the target multimedia data based on the playing control mode.
In a possible implementation manner, the determining module is configured to determine the playing control manner as segment playing in a case that the graph is a plurality of segment graphs; under the condition that the segmented graphs do not overlap with each other, determining the length proportion of each segmented graph; segmenting the target multimedia data into a plurality of multimedia segments based on the length proportion of each segmented graph and the playing time length of the target multimedia data; wherein the segmented graphics comprise rectangles or line segments.
In a possible implementation manner, the playing module is configured to play any one of the plurality of multimedia segments on the playing interface, where the playing interface includes a switching control; and responding to the triggering operation of the switching control, and playing a next multimedia segment corresponding to any one multimedia segment.
In a possible implementation manner, the determining module is configured to determine the playing control manner as segment playing in a case that the graph is a plurality of segment graphs; determining the length proportion of each segmented graph under the condition that the segmented graphs intersect; segmenting the target multimedia data into a plurality of multimedia segments based on the length proportion of each segmented graph and the playing time length of the target multimedia data; and determining the intersecting position of each segmented graph as the target time in each multimedia segment.
In a possible implementation manner, the playing module is configured to play any one of the plurality of multimedia segments on the playing interface, where the playing interface includes a switching control; and when the target time in any one multimedia segment is played, responding to the trigger operation of the switching control, and starting to play the next multimedia segment from the target time in the next multimedia segment corresponding to any one multimedia segment.
In a possible implementation manner, the determining module is configured to determine the playback control manner as loop playback if the graphic is a circular ring.
In a possible implementation manner, the determining module is configured to determine the playback control manner as a double-speed playback if the graphic is a double-speed graphic; determining the playing speed of the target multimedia data based on the number of the edges of the speed-doubling graph; wherein the multiple speed pattern comprises a polygon.
In a possible implementation manner, the determining module is configured to determine the play control manner as reverse play if the graphic is an arrow and the arrow points to the left.
In one aspect, a terminal is provided and includes one or more processors and one or more memories, where at least one program code is stored in the one or more memories, and the program code is loaded and executed by the one or more processors to implement operations performed by the method for controlling playback of multimedia data.
In one aspect, a computer-readable storage medium having at least one program code stored therein is provided, the program code being loaded and executed by a processor to implement the operations performed by the method for controlling playback of multimedia data.
In one aspect, a computer program product is provided, which includes computer code that is loaded and executed by a processor of a terminal to implement operations performed by the play control method of multimedia data.
According to the scheme, the user can draw the graph on the playing interface of the target multimedia data, and then the target multimedia data is played in the playing control mode corresponding to the graph based on the graph drawn by the user, so that the diversity of the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to be able to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram of an implementation environment of a method for controlling playback of multimedia data according to an embodiment of the present application;
fig. 2 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
fig. 3 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a user-drawn graph according to an embodiment of the present disclosure;
fig. 5 is an interface schematic diagram of a playing interface of multimedia data according to an embodiment of the present application;
fig. 6 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a user-drawn graph according to an embodiment of the present disclosure;
FIG. 8 is a schematic diagram of a user-drawn graph according to an embodiment of the present disclosure;
fig. 9 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
FIG. 10 is a schematic diagram of a user-drawn graph provided by an embodiment of the present application;
fig. 11 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
FIG. 12 is a schematic diagram of a user-drawn graph provided in an embodiment of the present application;
fig. 13 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
fig. 14 is a schematic structural diagram of a playing control apparatus for multimedia data according to an embodiment of the present application;
fig. 15 is a schematic structural diagram of a terminal according to an embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
Fig. 1 is a schematic diagram of an implementation environment of a method for controlling playback of multimedia data according to an embodiment of the present application, and referring to fig. 1, the implementation environment includes: a terminal 101 and a server 102.
The terminal 101 is at least one of a smart phone, a tablet computer, an e-book reader, an MP3(Moving Picture Experts Group Audio Layer III, motion Picture Experts compression standard Audio Layer 3) player, an MP4(Moving Picture Experts Group Audio Layer IV, motion Picture Experts compression standard Audio Layer 4) player, and a laptop. The terminal 101 and the server 102 are connected by wired or wireless communication, which is not limited in the embodiment of the present application. Multimedia data playing software (such as a video player and the like) is installed and operated on the terminal 101, and the terminal 101 can acquire the multimedia data from the server 102, or acquire the multimedia data from a local storage of the terminal 101, and then play the multimedia data based on the acquired multimedia data, so that a user can view the multimedia data through the terminal 101.
The terminal 101 generally refers to one of a plurality of terminals, and the embodiment of the present application is illustrated by the terminal 101. Those skilled in the art will appreciate that the number of terminals described above is greater or lesser in the more possible implementations. For example, the number of the terminals is only a few, or the number of the terminals is several tens or hundreds, or more, and the number of the terminals 101 and the type of the device are not limited in the embodiment of the present application.
The server 102 is at least one of a server, a plurality of servers, a cloud computing platform, and a virtualization center. The server 102 and the terminal 101 are connected by wired or wireless communication, which is not limited in the embodiment of the present application. The server 102 is associated with a multimedia database for storing a plurality of multimedia data, so that when the terminal 101 needs to acquire the multimedia data, the corresponding multimedia data is acquired from the multimedia database, and the acquired multimedia data is sent to the terminal 101, so that the terminal 101 plays the multimedia data based on the acquired multimedia data. Optionally, the number of the servers is greater or less, and the embodiment of the present application does not limit this. Of course, in more possible implementations, the server 102 also includes other functional servers in order to provide more comprehensive and diverse services.
Fig. 2 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application, and referring to fig. 2, the method includes:
201. and the terminal responds to the drawing operation on the playing interface of the target multimedia data and displays the graph generated based on the drawing operation.
In a possible implementation manner, the terminal plays the target multimedia data on the playing interface, the user can perform drawing operation on the playing interface in the playing process of the target multimedia data, and the terminal responds to the drawing operation of the user on the playing interface and displays the graph drawn by the user.
Optionally, the multimedia data is a video, or the multimedia data is an audio, or the multimedia data is of another type, which is not limited in this embodiment of the application. The graph is a segmented graph (such as a rectangle, a line segment, etc.), a circular ring, a double-speed graph (such as a polygon, etc.), etc., or the graph is of another type, which is not limited in this embodiment of the present application.
In the process of playing the target multimedia data, when the terminal starts to play the target multimedia data, the terminal can acquire the drawing operation performed by the user on the playing interface, that is, after the terminal starts to play the target multimedia data, the user can perform the drawing operation on the playing interface at any time, and the terminal can respond to the drawing operation of the user and display the graph generated based on the drawing operation.
Or when the target multimedia data is played for a preset time, the terminal displays prompt information, the prompt information is used for prompting that the time for performing the drawing operation is reached, and the user can perform the drawing operation in the playing interface after seeing the prompt information, so that the terminal can respond to the drawing operation of the user and display the graph generated based on the drawing operation.
By providing two selectable graph drawing occasions, the flexibility of drawing operation can be improved, and the flexibility of the multimedia data playing process is further improved. In addition, the two drawing timings mentioned above are only two exemplary illustrations, and there are more optional timings in more possible implementations, which are not limited in the embodiment of the present application.
In addition, when the target multimedia data is played, the terminal can display operation guide information on a playing interface of the target multimedia data, the operation guide information is used for guiding a user to draw a graph, and after the user sees the operation guide information, the user can know how to draw the graph on the playing interface, so that the user can smoothly perform drawing operation, and the terminal can respond to the drawing operation of the user and display the graph generated based on the drawing operation.
The operation guide information is displayed on the playing interface, so that a user can draw a graph based on the operation guide information displayed on the playing interface, the playing control of the multimedia data is realized, and the intelligence of the playing process of the multimedia data is improved.
For the process that a user draws a graph on a playing interface, in a possible implementation manner, a transparent layer is arranged on the upper layer of the playing interface, the user performs drawing operation on the playing interface, that is, the drawing operation is performed on the transparent layer, and a terminal responds to the drawing operation of the user and displays the graph generated based on the drawing operation.
In another possible implementation manner, the playing interface includes a graphics drawing area and a playing area, the terminal plays the target multimedia data in the playing area, the user can perform drawing operation in the graphics drawing area, and the terminal responds to the drawing operation in the graphics drawing area and displays graphics generated based on the drawing operation.
For example, the playing area is located at the left side of the graphics drawing area, or the graphics drawing area is located below the playing area, or the graphics drawing area is located at the lower left corner of the playing area, and so on.
It should be noted that the foregoing are only two exemplary manners, and do not limit the present application, and in a more possible implementation manner, the process of drawing a graphic on a playing interface by a user is implemented in other manners, which is not limited in the embodiment of the present application.
202. And the terminal determines the playing control mode corresponding to the graph.
Different graphs correspond to different playing control modes, and the corresponding relation between each graph and the playing control mode is stored in the terminal in advance, so that after the graph drawn by the user is determined, the terminal can determine the corresponding playing control mode based on the graph drawn by the user.
203. And the terminal plays the target multimedia data based on the play control mode.
According to the scheme provided by the embodiment of the application, the user can draw the graph on the playing interface of the target multimedia data, and then the target multimedia data is played in the playing control mode corresponding to the graph based on the graph drawn by the user, so that the diversity of the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
Fig. 2 is a basic flow chart of the present application, and the following further describes the scheme provided in the present application based on several specific implementation processes. First, when a graph drawn by a user is a segment graph which is not overlapped with each other, referring to fig. 3 for a corresponding playing control process, fig. 3 is a flowchart of a playing control method for multimedia data provided in an embodiment of the present application, where the method includes:
301. and the terminal responds to the drawing operation on the playing interface of the target multimedia data and displays the graph generated based on the drawing operation.
This step is similar to step 201 described above, and will not be described herein again.
302. And under the condition that the graph is a plurality of segmented graphs, the terminal determines the playing control mode of the target multimedia data as segmented playing.
In a possible implementation manner, when determining that the graph drawn by the user is a plurality of segmented graphs, the terminal determines the playing control manner corresponding to the plurality of segmented graphs as segmented playing according to the corresponding relationship between the stored graphs and the playing control manner, so that the playing control manner of the target multimedia data is determined as segmented playing.
The segmentation graph is a rectangle or a line segment, or the segmentation graph is of another type, which is not limited in the embodiment of the present application.
Taking the segment graph as a rectangle as an example, referring to fig. 4, fig. 4 is a schematic diagram of a graph drawn by a user according to an embodiment of the present application, and as shown in fig. 4, the user draws 4 rectangles with the same size, at this time, the terminal can determine that the playing control mode is segment playing based on the 4 rectangles drawn by the user.
303. In the case where the plurality of segment patterns do not overlap with each other, the terminal determines the length ratio of each segment pattern.
The segmented patterns are not overlapped, that is, any two segmented patterns in the segmented patterns are not completely overlapped. For the length proportion of each segmented figure, if the segmented figure is a line segment, the length proportion of each segmented figure, namely the length proportion of each line segment; if the segmented pattern is a rectangle and the sides of the rectangle include a length and a width, the length ratio of each segmented pattern, that is, the length ratio corresponding to the long side of each rectangle, is the same as the above process for determining the length ratio of each segmented pattern for other types of segmented patterns, and is not described herein again.
Still taking fig. 4 as an example, the 4 rectangles in fig. 4 do not overlap with each other, and at this time, the terminal determines that the lengths of the rectangles are the same, that is, the length ratio of the rectangles is 1:1:1: 1.
Fig. 4 is only an exemplary graph, and in a more possible implementation manner, the lengths of the rectangles drawn by the user are not exactly the same, for example, the length ratio of the rectangles is 1:2:1:1, or the length ratio is another value, which is not limited in the embodiment of the present application.
304. And the terminal segments the target multimedia data into a plurality of multimedia segments based on the length proportion of each segmented graph and the playing time length of the target multimedia data.
In a possible implementation manner, after determining the length proportion of each segmented graph, the terminal determines the playing time of each multimedia segment to be segmented based on the length proportion of each segmented graph and the playing time of the target multimedia data, so that the target multimedia data is segmented into a plurality of multimedia segments based on the determined playing time.
Still taking fig. 4 as an example, after the terminal determines that the length ratio of each rectangle is 1:1:1:1, if the playing time of the target multimedia data is 20 seconds, the terminal determines that the playing time of each multimedia segment to be divided is 5 seconds, so as to divide the target multimedia data into 4 multimedia segments of 0-5 seconds, 5-10 seconds, 10-15 seconds, and 15-20 seconds.
In addition, if the terminal determines that the length ratio of each segmented graph is 1:2:1:1 and the playing time of the target multimedia data is 20 seconds, the terminal determines that the playing time of each multimedia segment to be segmented is 4 seconds, 8 seconds, 4 seconds and 4 seconds respectively, so that the target multimedia data is segmented into 4 multimedia segments of 0-4 seconds, 4-12 seconds, 12-16 seconds and 16-20 seconds.
The segmenting of the target multimedia data into the multiple multimedia segments mentioned in the step 304 is to divide the playing duration of the target multimedia data into multiple time intervals, so as to obtain the multimedia segments corresponding to different time intervals, and the multimedia file corresponding to the target multimedia data is not segmented into multiple multimedia segment files, but in more possible implementation manners, when the target multimedia data is segmented into the multiple multimedia segments, the multimedia file corresponding to the target multimedia data is segmented into the multiple multimedia segment files, which is not limited in the embodiment of the present application.
The segment patterns and the length ratios of the segment patterns mentioned in the above steps 302 to 304 are all exemplary illustrations and do not limit the present application.
305. And the terminal plays any one of the plurality of multimedia fragments on the playing interface, and the playing interface comprises a switching control.
In a possible implementation manner, the terminal randomly selects any one multimedia segment from the plurality of multimedia segments obtained by segmentation, and then plays any one multimedia segment. Optionally, the terminal automatically plays the first multimedia segment after segmenting the target multimedia data into a plurality of multimedia segments.
The playing interface comprises a switching control, and the switching control is used for realizing switching of the multimedia clip played by the playing interface when being triggered. Referring to fig. 5, fig. 5 is an interface schematic diagram of a play interface provided in the embodiment of the present application, and a button 501 is the switching control.
306. And the terminal responds to the triggering operation of the switching control and plays the next multimedia segment corresponding to any one multimedia segment.
In a possible implementation manner, in the playing process of any multimedia clip, the user can trigger the switching control, and the terminal responds to the triggering operation of the switching control to switch the multimedia clip played by the playing interface to the next multimedia clip corresponding to any currently played multimedia clip.
Still taking the playing interface shown in fig. 5 as an example, if the currently played multimedia clip is the first multimedia clip in the playing interface shown in fig. 5 and the user triggers the button 501, the terminal responds to the triggering operation of the button 501 to switch the currently played multimedia clip to the second multimedia clip.
In a more possible implementation manner, if the user does not trigger the switching control in the playing process of any one of the multimedia segments, the terminal automatically plays a next multimedia segment corresponding to any one of the multimedia segments when the playing of any one of the multimedia segments is finished.
When the playing of the multimedia segment played on the playing interface is finished, the next multimedia segment is automatically played without manual operation of a user, so that the man-machine interaction efficiency is improved, and the intelligence of the multimedia data playing process is improved.
According to the scheme provided by the embodiment of the application, the user can draw a plurality of non-overlapping segmented graphs on the playing interface of the target multimedia data, and then the target multimedia data is segmented into a plurality of multimedia segments based on the plurality of non-overlapping segmented graphs drawn by the user, so that the plurality of segmented multimedia segments obtained through segmentation are played one by one, the playing of the target multimedia data is realized, the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved. And moreover, a switching control is provided on the playing interface, so that a user can switch among a plurality of multimedia fragments through the switching control, the operation is simple and convenient, the human-computer interaction efficiency is improved, and the user experience is improved.
The process shown in fig. 3 is a playing control process of multimedia data corresponding to a user only when the graph drawn by the user is a segment graph which is not overlapped with each other, and when the graph drawn by the user is an intersecting segment graph, the corresponding playing control process refers to fig. 6, where fig. 6 is a flowchart of a playing control method of multimedia data provided in an embodiment of the present application, and the method includes:
601. and the terminal responds to the drawing operation on the playing interface of the target multimedia data and displays the graph generated based on the drawing operation.
This step is similar to step 201 described above, and will not be described herein again.
602. And under the condition that the graph is a plurality of segmented graphs, the terminal determines the playing control mode of the target multimedia data as segmented playing.
In a possible implementation manner, when determining that the graph drawn by the user is a plurality of segmented graphs, the terminal determines the playing control manner corresponding to the plurality of segmented graphs as segmented playing according to the corresponding relationship between the stored graphs and the playing control manner, so that the playing control manner of the target multimedia data is determined as segmented playing.
The segmentation graph is a rectangle or a line segment, or the segmentation graph is of another type, which is not limited in the embodiment of the present application.
Taking the segment graph as a rectangle as an example, referring to fig. 7, fig. 7 is a schematic diagram of a graph drawn by a user according to an embodiment of the present application, and as shown in fig. 7, the user draws 2 rectangles with the same size, at this time, the terminal can determine that the playing control mode is segment playing based on the 2 rectangles drawn by the user.
603. In the case where the plurality of segment patterns intersect, the terminal determines the length ratio of each segment pattern.
If the segment graph is a rectangle, the segment graphs intersect, that is, the rectangles intersect, for any two rectangles of the plurality of rectangles, straight lines and collinearity exist inside the any two rectangles, or the any two rectangles intersect at a line segment, and the line segment is located inside the two rectangles. The sides of the rectangle include length and width, and the length proportion of each segment pattern, that is, the length proportion corresponding to the long side of each rectangle.
If the segment graph is a line segment, the segment graphs intersect, that is, if a plurality of line segments intersect, any two line segments of the line segments intersect at a point. The length ratio of each segment graph is also the length ratio corresponding to the length of each line segment.
Still taking fig. 7 as an example, the 2 rectangles in fig. 7 intersect at the line segment AB, and at this time, the terminal determines that the lengths of the rectangles are all the same, that is, the length ratio of the rectangles is 1: 1.
Fig. 7 is only an exemplary graph, and in a more possible implementation manner, the lengths of the rectangles drawn by the user are not exactly the same, for example, the length ratio of the rectangles is 2:3, or the length ratio is another value, which is not limited in the embodiment of the present application.
604. And the terminal segments the target multimedia data into a plurality of multimedia segments based on the length proportion of each segmented graph and the playing time length of the target multimedia data.
In a possible implementation manner, after determining the length proportion of each segmented graph, the terminal determines the playing time of each multimedia segment to be segmented based on the length proportion of each segmented graph and the playing time of the target multimedia data, so that the target multimedia data is segmented into a plurality of multimedia segments based on the determined playing time.
Still taking fig. 7 as an example, after the terminal determines that the length ratio of each rectangle is 1:1, if the playing time of the target multimedia data is 20 seconds, the terminal determines that the playing time of each multimedia segment to be divided is 10 seconds, so as to divide the target multimedia data into 2 multimedia segments of 0-10 seconds and 10-20 seconds.
In addition, if the terminal determines that the length ratio of each segmented graph is 2:3 and the playing time of the target multimedia data is 20 seconds, the terminal determines that the playing time of each multimedia segment to be segmented is 8 seconds and 12 seconds respectively, so that the target multimedia data is segmented into 2 multimedia segments of 0-8 seconds and 8-20 seconds.
605. And the terminal determines the intersecting position of each segmented graph as the target time in each multimedia segment.
In a possible implementation manner, if the intersecting position of each segment graph is located at the midpoint of each segment graph, the terminal determines the target time in each multimedia segment based on the intersecting position of each segment graph.
Still taking fig. 7 as an example, the two rectangles in fig. 7 intersect at the line segment AB, and the point a and the point B are both located at the midpoint of the two rectangles, and in combination with the terminal dividing the target multimedia data into two multimedia segments of 0-10 seconds and 10-20 seconds in step 604, the target time in the multimedia segment of 0-10 seconds is the 5 th second, and the target time in the multimedia segment of 10-20 seconds is the 15 th second.
In another possible implementation manner, if there is a position where any two segment graphics intersect, and the position is not located at the midpoint of any two segment graphics, the terminal obtains the drawing order of the segment graphics, and further determines the target time in each multimedia segment based on the drawing order of each segment graphic and the position where each segment graphic intersects.
Taking the segment graph drawn by the user as a rectangle as an example, referring to fig. 8, fig. 8 is a schematic diagram of a graph drawn by the user according to an embodiment of the present application, as shown in fig. 8, the length ratio of the rectangle ABCD and the rectangle EFGH is 1:1, the rectangle ABCD and the rectangle EFGH intersect at a line segment IJ, a point I and a point J are located at 1/5 of the rectangle ABCD, and the point I and the point J are located at a midpoint of the rectangle EFGH, and in combination with the terminal in the above step 604, the target multimedia data is divided into two multimedia segments of 0 to 10 seconds and 10 to 20 seconds, if the rectangle ABCD is drawn first and the rectangle EFGH is drawn subsequently, the target time in the multimedia segment of 0 to 10 seconds is 2 seconds, and the target time in the multimedia segment of 10 to 20 seconds is 15 seconds.
Or, in a more possible implementation manner, no matter where the intersecting position of each segment graph is located in the segment graph, the terminal acquires the drawing order of the segment graphs, and determines the target time in each multimedia segment based on the drawing order of each segment graph and the intersecting position of each segment graph.
By providing several possible ways of determining the target time, the diversity of the multimedia data processing process is increased, thereby improving the flexibility in the multimedia data processing process.
The segment patterns, the length ratios of the segment patterns, and the intersecting positions of the segment patterns mentioned in the above steps 602 to 305 are all exemplary illustrations and do not constitute limitations of the present application.
606. And the terminal plays any one of the plurality of multimedia fragments on the playing interface, and the playing interface comprises a switching control.
The step 606 is similar to the step 305, and will not be described herein again.
607. And when the target time in any one multimedia segment is played, the terminal responds to the trigger operation of the switching control and starts to play the next multimedia segment from the target time in the next multimedia segment corresponding to any one multimedia segment.
In a possible implementation manner, in the playing process of any one of the multimedia segments, the user can trigger the switching control, and if the user triggers the switching control when any one of the multimedia segments is played to the target time, the terminal responds to the triggering operation on the switching control, and in the playing interface, the next multimedia segment is played from the target time of the next multimedia segment corresponding to any one of the currently played multimedia segments.
Taking the playing interface shown in fig. 5 as an example, if the graph drawn by the user on the playing interface is as shown in fig. 7, and in the playing interface shown in fig. 5, the currently played multimedia clip is the first multimedia clip, when the first multimedia clip is played for the 5 th second, the user triggers the button 501, and the terminal responds to the triggering operation of the button 501, and plays the second multimedia clip from the 15 th second of the second multimedia clip.
Still taking the playing interface shown in fig. 5 as an example, if the graph drawn by the user on the playing interface is as shown in fig. 8, and in the playing interface shown in fig. 5, the currently played multimedia clip is the first multimedia clip, when the first multimedia clip is played for the 2 nd second, the user triggers the button 501, and the terminal responds to the triggering operation of the button 501, and plays the second multimedia clip from the 15 th second of the second multimedia clip.
In addition, if the user triggers the switching control at a time other than the target time, the terminal responds to the triggering operation of the switching control, and plays the next multimedia clip from the 0 th second of the next multimedia clip corresponding to the currently played multimedia clip.
In a more possible implementation manner, if the user does not trigger the switching control in the playing process of any one of the multimedia segments, the terminal automatically plays a next multimedia segment corresponding to any one of the multimedia segments when the playing of any one of the multimedia segments is finished.
When the playing of the multimedia segment played on the playing interface is finished, the next multimedia segment is automatically played without manual operation of a user, so that the man-machine interaction efficiency is improved, and the intelligence of the multimedia data playing process is improved.
According to the scheme provided by the embodiment of the application, the user can draw the intersected multiple segmented graphs on the playing interface of the target multimedia data, and then the target multimedia data is segmented into multiple multimedia segments based on the intersected multiple segmented graphs drawn by the user, so that the multiple segmented multimedia segments obtained through segmentation are played one by one, the playing of the target multimedia data is realized, the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved. And moreover, the switching control is provided on the playing interface, so that a user can realize the jumping switching among a plurality of multimedia fragments by triggering the switching control when playing to the target moment corresponding to the intersecting position, the operation is simple and convenient, the human-computer interaction efficiency is improved, and the user experience is improved.
The process shown in fig. 6 is only a playing control process corresponding to a graph drawn by a user as an intersecting segment graph, and when the graph drawn by the user is a circular ring, the corresponding playing control process refers to fig. 9, where fig. 9 is a flowchart of a playing control method for multimedia data provided in an embodiment of the present application, the method includes:
901. and the terminal responds to the drawing operation on the playing interface of the target multimedia data and displays the graph generated based on the drawing operation.
This step is similar to step 201 described above, and will not be described herein again.
902. And under the condition that the graph is a circular ring, the terminal determines the playing control mode of the target multimedia data as circular playing.
In a possible implementation manner, when determining that the graph drawn by the user is a circular ring, the terminal determines that the playing control mode corresponding to the circular ring is circular playing according to the corresponding relationship between the stored graph and the playing control mode, so that the playing control mode of the target multimedia data is determined to be circular playing.
Referring to fig. 10, fig. 10 is a schematic view of a graph drawn by a user according to an embodiment of the present application, and as shown in fig. 10, the graph drawn by the user is a circular ring, at this time, the terminal can determine that the play control mode is loop play based on the circular ring drawn by the user.
903. And when the target multimedia data is played, the terminal plays the target multimedia data from the beginning.
For example, if the playing duration of the target multimedia data is 20 seconds, the terminal starts to play the target multimedia data from the 0 th second of the target multimedia data when the terminal finishes playing the 20 th second of the target multimedia data.
In more possible implementation manners, the target multimedia data is provided with a cycle time threshold, and when the playing time of the target multimedia data is smaller than the cycle time threshold, each time the playing of the target multimedia data is finished, the terminal can play the target multimedia data from the beginning. And when the playing times of the target multimedia data are equal to the cycle time threshold, the terminal stops playing the target multimedia data.
The threshold of the number of loops is preset by a developer of multimedia data playing software, or is preset by a publisher (or producer) of the target multimedia data, or is preset by a user viewing the target multimedia data, which is not limited in the embodiment of the present application.
By setting the cycle time threshold value for the target multimedia data, the situation that the target multimedia data is infinitely cyclically played is avoided, and the intelligence of the multimedia data playing process is improved.
According to the scheme provided by the embodiment of the application, the user can draw the ring on the playing interface of the target multimedia data, and then the playing control mode of the target multimedia data is determined to be the circular playing based on the ring drawn by the user, so that the target multimedia data is played circularly, the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
The process shown in fig. 9 is only the playing control process corresponding to the graph drawn by the user as a circular ring, and when the graph drawn by the user is a multiple speed graph, the corresponding playing control process refers to fig. 11, where fig. 11 is a flowchart of a playing control method for multimedia data provided in an embodiment of the present application, the method includes:
1101. and the terminal responds to the drawing operation on the playing interface of the target multimedia data and displays the graph generated based on the drawing operation.
This step is similar to step 201 described above, and will not be described herein again.
1102. And under the condition that the graph is a double-speed graph, the terminal determines the playing control mode of the target multimedia data as circular playing.
In a possible implementation manner, when determining that the graph drawn by the user is a multiple-speed graph, the terminal determines that the playing control mode corresponding to the multiple-speed graph is multiple-speed playing according to the corresponding relationship between the stored graph and the playing control mode, so that the playing control mode of the target multimedia data is determined to be multiple-speed playing.
The speed-multiplying pattern is a polygon, or the speed-multiplying pattern is of another type, which is not limited in this embodiment of the application.
Taking the multiple-speed graphics as an example, referring to fig. 12, fig. 12 is a schematic diagram of a graphics drawn by a user according to an embodiment of the present application, and as shown in fig. 12, the graphics drawn by the user is a polygon, at this time, the terminal can determine that the playback control mode is multiple-speed playback based on the polygon drawn by the user.
1103. And the terminal determines the playing speed of the target multimedia data based on the number of the edges of the double-speed graph.
Still taking fig. 12 as an example, the multiple-speed graph drawn by the user is a hexagon, that is, the number of sides of the multiple-speed graph drawn by the user is 6, and the terminal determines the playing speed of the target multimedia data to be 6 based on the number of sides of the hexagon.
1104. And the terminal plays the target multimedia data according to the playing speed of the target multimedia data.
Still taking fig. 12 as an example, as shown in fig. 12, the multiple speed graph drawn by the user is a hexagon, and accordingly, the playing speed of the target multimedia data is 6, and when the terminal plays the target multimedia data, the terminal plays the target multimedia data at six times.
According to the scheme provided by the embodiment of the application, the user can draw the multi-speed graph such as a polygon on the playing interface of the target multimedia data, the playing control mode of the target multimedia data is determined to be multi-speed playing based on the multi-speed graph drawn by the user, the target multimedia data is played at the corresponding multi-speed based on the number of the edges of the multi-speed graph, the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
The process shown in fig. 11 is only the playing control process corresponding to the graphics drawn by the user as the double-speed graphics, and when the graphics drawn by the user is an arrow pointing to the left side, the corresponding playing control process refers to fig. 13, where fig. 13 is a flowchart of a playing control method for multimedia data provided in an embodiment of the present application, the method includes:
1301. and the terminal responds to the drawing operation on the playing interface of the target multimedia data and displays the graph generated based on the drawing operation.
This step is similar to step 201 described above, and will not be described herein again.
1302. And under the condition that the graph is an arrow and the arrow points to the left side, the terminal determines the playing control mode of the target multimedia data as reverse playing.
In a possible implementation manner, when the terminal determines that the graph drawn by the user is an arrow and the arrow points to the left side, the terminal determines that the playing control mode corresponding to the arrow pointing to the left side is reverse playing according to the corresponding relationship between the stored graph and the playing control mode, so that the playing control mode of the target multimedia data is determined to be reverse playing.
1303. And the terminal plays the target multimedia data in a reverse order from the moment when the target multimedia data is played currently.
For example, if the target multimedia data is currently played for 10 seconds, the terminal starts from 10 seconds and plays the target multimedia data forward, that is, plays 9 seconds, then plays 8 seconds, 7 seconds, … …, and so on until playing 0 seconds.
According to the scheme provided by the embodiment of the application, the arrow pointing to the left can be drawn on the playing interface of the target multimedia data by the user, and then the playing control mode of the target multimedia data is determined to be reverse playing based on the arrow pointing to the left drawn by the user, so that the target multimedia data is played in reverse order, the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
All the above optional technical solutions can be combined arbitrarily to form optional embodiments of the present application, and are not described herein again.
Fig. 14 is a schematic structural diagram of a playing control device for multimedia data according to an embodiment of the present application, and referring to fig. 14, the device includes:
a display module 1401, configured to respond to a drawing operation on a play interface of target multimedia data, and display a graphic generated based on the drawing operation;
a determining module 1402, configured to determine a playing control manner corresponding to the graphic;
a playing module 1403, configured to play the target multimedia data based on the playing control manner.
The device provided by the embodiment of the application can be used for drawing the graph on the playing interface of the target multimedia data by providing the device, and then playing the target multimedia data in the playing control mode corresponding to the graph based on the graph drawn by the user, so that the diversity of the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
In a possible implementation manner, the determining module 1402 is configured to determine the playing control manner as segment playing if the graph is a plurality of segment graphs; under the condition that the segmented graphs do not overlap with each other, determining the length proportion of each segmented graph; segmenting the target multimedia data into a plurality of multimedia segments based on the length proportion of each segmented graph and the playing time length of the target multimedia data; wherein the segmented graphics comprise rectangles or line segments.
In a possible implementation manner, the playing module 1403 is configured to play any one of the multiple multimedia segments in the playing interface, where the playing interface includes a switching control; and responding to the triggering operation of the switching control, and playing a next multimedia segment corresponding to any one multimedia segment.
In a possible implementation manner, the determining module 1402 is configured to determine the playing control manner as segment playing if the graph is a plurality of segment graphs; determining the length proportion of each segmented graph under the condition that the segmented graphs intersect; segmenting the target multimedia data into a plurality of multimedia segments based on the length proportion of each segmented graph and the playing time length of the target multimedia data; and determining the target time in each multimedia segment based on the crossed position of each segmented graph.
In a possible implementation manner, the playing module 1403 is configured to play any one of the multiple multimedia segments in the playing interface, where the playing interface includes a switching control; and when the target time in any one multimedia segment is played, responding to the trigger operation of the switching control, and starting to play the next multimedia segment from the target time in the next multimedia segment corresponding to any one multimedia segment.
In a possible implementation manner, the determining module 1402 is configured to determine the playing control manner as a loop playing in a case that the graphic is a circular ring.
In a possible implementation manner, the determining module 1402 is configured to determine the playback control manner as a double-speed playback if the graphic is a double-speed graphic; determining the playing speed of the target multimedia data based on the number of the edges of the speed-doubling graph; wherein the multiple speed pattern comprises a polygon.
In a possible implementation manner, the determining module 1402 is configured to determine the playing control manner as reverse playing if the graphic is an arrow and the arrow points to the left.
It should be noted that: the playing control device for multimedia data provided in the above embodiment only exemplifies the division of the above functional modules when controlling the playing of the target multimedia data, and in practical applications, the above function distribution is completed by different functional modules according to needs, that is, the internal structure of the terminal is divided into different functional modules to complete all or part of the above described functions. In addition, the playing control device of multimedia data and the playing control method of multimedia data provided by the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments and will not be described herein again.
Fig. 15 is a schematic structural diagram of a terminal according to an embodiment of the present application. The terminal 1500 is: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4), a notebook computer, or a desktop computer. Terminal 1500 may also be referred to as user equipment, a portable terminal, a laptop terminal, a desktop terminal, or other names.
In general, terminal 1500 includes: one or more processors 1501 and one or more memories 1502.
Processor 1501 includes one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 1501 is implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 1501 includes a main processor and a coprocessor, and the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 1501 is integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content that the display screen needs to display. In some embodiments, processor 1501 further includes an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.
The memory 1502 includes one or more computer-readable storage media that, in one possible implementation, are non-transitory. The memory 1502 also includes high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in the memory 1502 is used to store at least one program code for execution by the processor 1501 to implement the method for controlling playback of multimedia data provided by the method embodiments of the present application.
In some embodiments, the terminal 1500 may further include: a peripheral interface 1503 and at least one peripheral. The processor 1501, memory 1502, and peripheral interface 1503 are connected by bus or signal lines. Each peripheral device is connected to the peripheral device interface 1503 via a bus, a signal line, or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1504, a display 1505, a camera assembly 1506, an audio circuit 1507, a positioning assembly 1508, and a power supply 1509.
The peripheral interface 1503 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 1501 and the memory 1502. In some embodiments, the processor 1501, memory 1502, and peripheral interface 1503 are integrated on the same chip or circuit board; in some other embodiments, any one or both of the processor 1501, the memory 1502, and the peripheral interface 1503 can be implemented on a separate chip or circuit board, which is not limited in this embodiment.
The Radio Frequency circuit 1504 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuitry 1504 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 1504 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1504 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuit 1504 communicates with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 1504 further includes NFC (Near Field Communication) related circuits, which are not limited in this application.
The display screen 1505 is used to display a UI (User Interface). The UI includes graphics, text, icons, video, and any combination thereof. When the display screen 1505 is a touch display screen, the display screen 1505 also has the ability to capture touch signals on or over the surface of the display screen 1505. The touch signal can be input to the processor 1501 as a control signal for processing. In this case, the display screen 1505 can also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, display 1505 is one, provided on the front panel of terminal 1500; in other embodiments, the displays 1505 are at least two, each disposed on a different surface of the terminal 1500 or in a folded design; in other embodiments, display 1505 is a flexible display disposed on a curved surface or a folded surface of terminal 1500. Even more, the display 1505 is arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The Display screen 1505 is made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode) and other materials.
The camera assembly 1506 is used to capture images or video. Optionally, the camera assembly 1506 includes a front camera and a rear camera. Generally, a front camera is disposed at a front panel of the terminal, and a rear camera is disposed at a rear surface of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 1506 also includes a flash. Optionally, the flash is a monochrome temperature flash, or a bi-color temperature flash. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp and can be used for light compensation under different color temperatures.
The audio circuitry 1507 includes a microphone and speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 1501 for processing or inputting the electric signals to the radio frequency circuit 1504 to realize voice communication. For the purpose of stereo sound collection or noise reduction, a plurality of microphones are respectively arranged at different positions of the terminal 1500. Optionally, the microphone is an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 1501 or the radio frequency circuit 1504 into sound waves. Alternatively, the speaker is a conventional membrane speaker, or alternatively, the speaker is a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being and converting the electric signal into a sound wave inaudible to the human being to measure a distance. In some embodiments, the audio circuitry 1507 also includes a headphone jack.
The positioning component 1508 is used to locate the current geographic position of the terminal 1500 for navigation or LBS (Location Based Service). The Positioning component 1508 is a Positioning component based on a Global Positioning System (GPS) in the united states, a beidou System in china, a graves System in russia, or a galileo System in the european union.
Power supply 1509 is used to power the various components in terminal 1500. Power supply 1509 is an alternating current, direct current, disposable battery or rechargeable battery. When the power supply 1509 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charge technology.
In some embodiments, the terminal 1500 also includes one or more sensors 1510. The one or more sensors 1510 include, but are not limited to: acceleration sensor 1511, gyro sensor 1512, pressure sensor 1513, fingerprint sensor 1514, optical sensor 1515, and proximity sensor 1516.
The acceleration sensor 1511 can detect the magnitude of acceleration on three coordinate axes of the coordinate system established with the terminal 1500. For example, the acceleration sensor 1511 can be used to detect components of the gravitational acceleration on three coordinate axes. The processor 1501 can control the display screen 1505 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 1511. The acceleration sensor 1511 can also be used for acquisition of motion data of a game or a user.
The gyro sensor 1512 can detect the body direction and the rotation angle of the terminal 1500, and the gyro sensor 1512 can acquire the 3D motion of the user on the terminal 1500 in cooperation with the acceleration sensor 1511. The processor 1501 can implement the following functions according to the data collected by the gyro sensor 1512: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.
Pressure sensor 1513 is disposed on the side frame of terminal 1500 and/or underneath display 1505. When the pressure sensor 1513 is disposed on the side frame of the terminal 1500, the holding signal of the user to the terminal 1500 can be detected, and the processor 1501 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 1513. When the pressure sensor 1513 is disposed at a lower layer of the display screen 1505, the processor 1501 controls the operability control on the UI interface in accordance with the pressure operation of the user on the display screen 1505. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.
The fingerprint sensor 1514 is configured to capture a fingerprint of the user, and the processor 1501 identifies the user based on the fingerprint captured by the fingerprint sensor 1514, or the fingerprint sensor 1514 identifies the user based on the captured fingerprint. Upon recognizing that the user's identity is a trusted identity, the processor 1501 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings, etc. Optionally, a fingerprint sensor 1514 is provided on the front, back or side of the terminal 1500. When a physical key or vendor Logo is provided on the terminal 1500, the fingerprint sensor 1514 is integrated with the physical key or vendor Logo.
The optical sensor 1515 is used to collect ambient light intensity. In one embodiment, processor 1501 can control the brightness of display screen 1505 based on the intensity of ambient light collected by optical sensor 1515. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1505 is increased; when the ambient light intensity is low, the display brightness of the display screen 1505 is adjusted down. In another embodiment, the processor 1501 can also dynamically adjust the shooting parameters of the camera assembly 1506 based on the ambient light intensity collected by the optical sensor 1515.
A proximity sensor 1516, also known as a distance sensor, is typically provided on the front panel of the terminal 1500. The proximity sensor 1516 is used to collect the distance between the user and the front surface of the terminal 1500. In one embodiment, when the proximity sensor 1516 detects that the distance between the user and the front surface of the terminal 1500 gradually decreases, the processor 1501 controls the display 1505 to switch from the bright screen state to the dark screen state; when the proximity sensor 1516 detects that the distance between the user and the front surface of the terminal 1500 gradually becomes larger, the processor 1501 controls the display 1505 to switch from the breath screen state to the bright screen state.
Those skilled in the art will appreciate that the configuration shown in fig. 15 does not constitute a limitation of terminal 1500, and that terminal 1500 may include more or fewer components than shown, or combine certain components, or employ a different arrangement of components in more possible implementations.
In an exemplary embodiment, there is also provided a computer-readable storage medium, such as a memory, including program code executable by a processor to perform the method for controlling playback of multimedia data in the above-described embodiments. For example, the computer-readable storage medium is a Read-Only Memory (ROM), a Random Access Memory (RAM), a Compact Disc Read-Only Memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, and the like.
In an exemplary embodiment, there is also provided a computer program product including computer program code that is loaded and executed by a processor of a terminal to implement the play control method of multimedia data in the above-described embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments are implemented by hardware, or implemented by hardware related to a program and a program code, and the program is stored in a computer readable storage medium, and the above mentioned storage medium is a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only exemplary of the present application and should not be taken as limiting, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (11)

1. A method for controlling playback of multimedia data, the method comprising:
responding to a drawing operation on a playing interface of the target multimedia data, and displaying a graph generated based on the drawing operation;
determining a playing control mode corresponding to the graph;
and playing the target multimedia data based on the playing control mode.
2. The method according to claim 1, wherein the determining the playback control mode corresponding to the graphic comprises:
under the condition that the graphics are a plurality of segmented graphics, determining the playing control mode as segmented playing;
under the condition that the segmented graphs do not overlap with each other, determining the length proportion of each segmented graph;
segmenting the target multimedia data into a plurality of multimedia segments based on the length proportion of each segmented graph and the playing time length of the target multimedia data;
wherein the segmented graphics comprise rectangles or line segments.
3. The method according to claim 2, wherein said playing the target multimedia data based on the playing control manner comprises:
playing any one of the plurality of multimedia clips on the playing interface, wherein the playing interface comprises a switching control;
and responding to the triggering operation of the switching control, and playing a next multimedia segment corresponding to any one multimedia segment.
4. The method according to claim 1, wherein the determining the playback control mode corresponding to the graphic comprises:
under the condition that the graphics are a plurality of segmented graphics, determining the playing control mode as segmented playing;
determining the length proportion of each segmented graph under the condition that the segmented graphs intersect;
segmenting the target multimedia data into a plurality of multimedia segments based on the length proportion of each segmented graph and the playing time length of the target multimedia data;
and determining the intersecting position of each segmented graph as the target time in each multimedia segment.
5. The method according to claim 4, wherein said playing the target multimedia data based on the playing control manner comprises:
playing any one of the plurality of multimedia clips on the playing interface, wherein the playing interface comprises a switching control;
and when the target time in any one of the multimedia segments is played, responding to the trigger operation of the switching control, and starting to play the next multimedia segment from the target time in the next multimedia segment corresponding to any one of the multimedia segments.
6. The method according to claim 1, wherein the determining the playback control mode corresponding to the graphic comprises:
and under the condition that the graph is a circular ring, determining the playing control mode as circular playing.
7. The method according to claim 1, wherein the determining the playback control mode corresponding to the graphic comprises:
under the condition that the graph is a double-speed graph, determining the playing control mode as double-speed playing;
determining the playing speed of the target multimedia data based on the number of edges of the speed-multiplying graph;
wherein the multiple speed pattern comprises a polygon.
8. The method according to claim 1, wherein the determining the playback control mode corresponding to the graphic comprises:
and when the graph is an arrow and the arrow points to the left side, determining the playing control mode as reverse playing.
9. An apparatus for controlling playback of multimedia data, the apparatus comprising:
the display module is used for responding to the drawing operation on the playing interface of the target multimedia data and displaying the graph generated based on the drawing operation;
the determining module is used for determining a playing control mode corresponding to the graph;
and the playing module is used for playing the target multimedia data based on the playing control mode.
10. A terminal, characterized in that the terminal comprises one or more processors and one or more memories, wherein at least one program code is stored in the one or more memories, and the program code is loaded and executed by the one or more processors to implement the operations performed by the play control method of multimedia data according to any one of claims 1 to 8.
11. A computer-readable storage medium having at least one program code stored therein, the program code being loaded and executed by a processor to implement the operations performed by the playback control method of multimedia data according to any one of claims 1 to 8.
CN202110838601.XA 2021-07-23 2021-07-23 Method, device, terminal and readable storage medium for controlling playing of multimedia data Active CN113507647B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110838601.XA CN113507647B (en) 2021-07-23 2021-07-23 Method, device, terminal and readable storage medium for controlling playing of multimedia data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110838601.XA CN113507647B (en) 2021-07-23 2021-07-23 Method, device, terminal and readable storage medium for controlling playing of multimedia data

Publications (2)

Publication Number Publication Date
CN113507647A true CN113507647A (en) 2021-10-15
CN113507647B CN113507647B (en) 2024-02-20

Family

ID=78013978

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110838601.XA Active CN113507647B (en) 2021-07-23 2021-07-23 Method, device, terminal and readable storage medium for controlling playing of multimedia data

Country Status (1)

Country Link
CN (1) CN113507647B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104156162A (en) * 2013-05-14 2014-11-19 腾讯科技（深圳）有限公司 Broadcast progress adjusting method, device and terminal
WO2017016339A1 (en) * 2015-07-27 2017-02-02 腾讯科技（深圳）有限公司 Video sharing method and device, and video playing method and device
US20170185240A1 (en) * 2015-12-28 2017-06-29 The Directv Group, Inc. Circular video player controls
CN107295416A (en) * 2017-05-05 2017-10-24 中广热点云科技有限公司 The method and apparatus for intercepting video segment
CN108650554A (en) * 2018-04-26 2018-10-12 维沃移动通信有限公司 A kind of multimedia file broadcasting control method and mobile terminal
CN110113645A (en) * 2019-05-09 2019-08-09 腾讯科技（深圳）有限公司 Control method for playing back, device, electronic equipment and the storage medium of multimedia equipment
CN111061412A (en) * 2019-10-31 2020-04-24 北京奇艺世纪科技有限公司 Playing control method and device for multimedia resources
CN111327951A (en) * 2020-03-24 2020-06-23 苏州科达科技股份有限公司 Multimedia data playing method, device, system and storage medium
CN112104915A (en) * 2020-09-14 2020-12-18 腾讯科技（深圳）有限公司 Video data processing method and device and storage medium
US20200402539A1 (en) * 2019-06-18 2020-12-24 Shanghai Bilibill Technology Co., LTD. Method and device of playing video, and computing device

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104156162A (en) * 2013-05-14 2014-11-19 腾讯科技（深圳）有限公司 Broadcast progress adjusting method, device and terminal
WO2017016339A1 (en) * 2015-07-27 2017-02-02 腾讯科技（深圳）有限公司 Video sharing method and device, and video playing method and device
US20170185240A1 (en) * 2015-12-28 2017-06-29 The Directv Group, Inc. Circular video player controls
CN107295416A (en) * 2017-05-05 2017-10-24 中广热点云科技有限公司 The method and apparatus for intercepting video segment
CN108650554A (en) * 2018-04-26 2018-10-12 维沃移动通信有限公司 A kind of multimedia file broadcasting control method and mobile terminal
CN110113645A (en) * 2019-05-09 2019-08-09 腾讯科技（深圳）有限公司 Control method for playing back, device, electronic equipment and the storage medium of multimedia equipment
US20200402539A1 (en) * 2019-06-18 2020-12-24 Shanghai Bilibill Technology Co., LTD. Method and device of playing video, and computing device
CN111061412A (en) * 2019-10-31 2020-04-24 北京奇艺世纪科技有限公司 Playing control method and device for multimedia resources
CN111327951A (en) * 2020-03-24 2020-06-23 苏州科达科技股份有限公司 Multimedia data playing method, device, system and storage medium
CN112104915A (en) * 2020-09-14 2020-12-18 腾讯科技（深圳）有限公司 Video data processing method and device and storage medium

Also Published As

Publication number Publication date
CN113507647B (en) 2024-02-20

Similar Documents

Publication Publication Date Title
CN110602321B (en) Application program switching method and device, electronic device and storage medium
CN107908929B (en) Method and device for playing audio data
CN108965922B (en) Video cover generation method and device and storage medium
CN109068008B (en) Ringtone setting method, device, terminal and storage medium
CN112181572A (en) Interactive special effect display method and device, terminal and storage medium
CN112044065B (en) Virtual resource display method, device, equipment and storage medium
CN110288689B (en) Method and device for rendering electronic map
CN110868636B (en) Video material intercepting method and device, storage medium and terminal
CN111459363A (en) Information display method, device, equipment and storage medium
CN111083526B (en) Video transition method and device, computer equipment and storage medium
CN112770173A (en) Live broadcast picture processing method and device, computer equipment and storage medium
CN112565806A (en) Virtual gift presenting method, device, computer equipment and medium
CN108845777B (en) Method and device for playing frame animation
CN112966130B (en) Multimedia resource display method, device, terminal and storage medium
CN112822544B (en) Video material file generation method, video synthesis method, device and medium
CN111158575B (en) Method, device and equipment for terminal to execute processing and storage medium
CN112616082A (en) Video preview method, device, terminal and storage medium
CN110152309B (en) Voice communication method, device, electronic equipment and storage medium
CN109032492B (en) Song cutting method and device
EP4125274A1 (en) Method and apparatus for playing videos
CN108228052B (en) Method and device for triggering operation of interface component, storage medium and terminal
CN111464829B (en) Method, device and equipment for switching media data and storage medium
CN110868642B (en) Video playing method, device and storage medium
CN110688046B (en) Song playing method and device and storage medium
CN108877845B (en) Song playing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant