CN113507647B - Method, device, terminal and readable storage medium for controlling playing of multimedia data - Google Patents

Method, device, terminal and readable storage medium for controlling playing of multimedia data Download PDF

Info

Publication number
CN113507647B
CN113507647B CN202110838601.XA CN202110838601A CN113507647B CN 113507647 B CN113507647 B CN 113507647B CN 202110838601 A CN202110838601 A CN 202110838601A CN 113507647 B CN113507647 B CN 113507647B
Authority
CN
China
Prior art keywords
playing
multimedia data
graph
segment
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110838601.XA
Other languages
Chinese (zh)
Other versions
CN113507647A (en
Inventor
刘春宇
党正军
夏佳权
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Kugou Computer Technology Co Ltd
Original Assignee
Guangzhou Kugou Computer Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Kugou Computer Technology Co Ltd filed Critical Guangzhou Kugou Computer Technology Co Ltd
Priority to CN202110838601.XA priority Critical patent/CN113507647B/en
Publication of CN113507647A publication Critical patent/CN113507647A/en
Application granted granted Critical
Publication of CN113507647B publication Critical patent/CN113507647B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The application provides a play control method, a play control device, a play control terminal and a readable storage medium of multimedia data, and belongs to the technical field of multimedia. According to the method and the device, the user can draw the graph on the playing interface of the target multimedia data, and then based on the graph drawn by the user, the target multimedia data is played in a playing control mode corresponding to the graph, so that the diversity of the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.

Description

Method, device, terminal and readable storage medium for controlling playing of multimedia data
Technical Field
The present invention relates to the field of multimedia technologies, and in particular, to a method and apparatus for playing control of multimedia data, a terminal, and a readable storage medium.
Background
With the development of multimedia technology, video playing software also presents diversified development modes. However, the current video playing software only supports three playing control modes of positive sequence playing, reverse sequence playing and jumping to the corresponding playing position (namely Seek operation or jump operation) by dragging a playing sliding block on a progress bar, so that the flexibility and the intelligence of video playing are poor.
Disclosure of Invention
The embodiment of the application provides a play control method, a play control device, a play control terminal and a readable storage medium for multimedia data, which can improve the flexibility and the intelligence of multimedia data play. The technical scheme provided by the application is as follows:
in one aspect, a method for controlling playing of multimedia data is provided, the method comprising:
displaying a graphic generated based on a drawing operation in response to the drawing operation at a playback interface of the target multimedia data;
determining a play control mode corresponding to the graph;
and playing the target multimedia data based on the playing control mode.
In one possible implementation manner, determining the play control manner corresponding to the graph includes:
determining the playing control mode as segmented playing under the condition that the graph is a plurality of segmented graphs;
determining the length proportion of each segment graph under the condition that the segment graphs are not overlapped with each other;
dividing the target multimedia data into a plurality of multimedia fragments based on the length proportion of each segmented graph and the playing time length of the target multimedia data;
wherein the segmentation graphic comprises a rectangle or a line segment.
In one possible implementation manner, playing the target multimedia data based on the play control manner includes:
Playing any one of the plurality of multimedia fragments on the playing interface, wherein the playing interface comprises a switching control;
and responding to the triggering operation of the switching control, and playing the next multimedia fragment corresponding to any one multimedia fragment.
In one possible implementation manner, determining the play control manner corresponding to the graph includes:
determining the playing control mode as segmented playing under the condition that the graph is a plurality of segmented graphs;
determining the length proportion of each segment graph under the condition that the plurality of segment graphs intersect;
dividing the target multimedia data into a plurality of multimedia fragments based on the length proportion of each segmented graph and the playing time length of the target multimedia data;
and determining the intersecting position of each segment graph as the target moment in each multimedia segment.
In one possible implementation manner, playing the target multimedia data based on the play control manner includes:
playing any one of the plurality of multimedia fragments on the playing interface, wherein the playing interface comprises a switching control;
and when the target moment in any one of the multimedia fragments is played, responding to the triggering operation of the switching control, and starting to play the next multimedia fragment from the target moment in the next multimedia fragment corresponding to the any one of the multimedia fragments.
In one possible implementation manner, determining the play control manner corresponding to the graph includes:
and when the graph is a circular ring, determining the playing control mode as circular playing.
In one possible implementation manner, determining the play control manner corresponding to the graph includes:
under the condition that the graph is a double-speed graph, determining the playing control mode as double-speed playing;
determining the playing speed of the target multimedia data based on the number of edges of the double-speed graph;
wherein the multiple speed pattern comprises a polygon.
In one possible implementation manner, determining the play control manner corresponding to the graph includes:
in the case where the graphic is an arrow and the arrow points to the left, the play control mode is determined to be reverse play.
In one aspect, there is provided a play control device for multimedia data, the device comprising:
a display module for displaying a graphic generated based on a drawing operation in response to the drawing operation at a playback interface of the target multimedia data;
the determining module is used for determining a play control mode corresponding to the graph;
and the playing module is used for playing the target multimedia data based on the playing control mode.
In one possible implementation manner, the determining module is configured to determine the play control manner as a segment play when the graphic is a plurality of segment graphics; determining the length proportion of each segment graph under the condition that the segment graphs are not overlapped with each other; dividing the target multimedia data into a plurality of multimedia fragments based on the length proportion of each segmented graph and the playing time length of the target multimedia data; wherein the segmentation graphic comprises a rectangle or a line segment.
In one possible implementation, the playing module is configured to play any one of the plurality of multimedia clips at the playing interface, where the playing interface includes a switch control; and responding to the triggering operation of the switching control, and playing the next multimedia fragment corresponding to any one multimedia fragment.
In one possible implementation manner, the determining module is configured to determine the play control manner as a segment play when the graphic is a plurality of segment graphics; determining the length proportion of each segment graph under the condition that the plurality of segment graphs intersect; dividing the target multimedia data into a plurality of multimedia fragments based on the length proportion of each segmented graph and the playing time length of the target multimedia data; and determining the intersecting position of each segment graph as the target moment in each multimedia segment.
In one possible implementation, the playing module is configured to play any one of the plurality of multimedia clips at the playing interface, where the playing interface includes a switch control; and when the target moment in any one of the multimedia fragments is played, responding to the triggering operation of the switching control, and starting to play the next multimedia fragment from the target moment in the next multimedia fragment corresponding to the any one of the multimedia fragments.
In one possible implementation manner, the determining module is configured to determine the play control manner as a circular play when the graph is a ring.
In one possible implementation manner, the determining module is configured to determine that the play control mode is double-speed play when the graphic is double-speed graphic; determining the playing speed of the target multimedia data based on the number of edges of the double-speed graph; wherein the multiple speed pattern comprises a polygon.
In one possible implementation manner, the determining module is configured to determine that the play control manner is reverse play when the graphic is an arrow and the arrow points to the left.
In one aspect, a terminal is provided that includes one or more processors and one or more memories having at least one program code stored therein, the program code being loaded and executed by the one or more processors to implement operations performed by a play control method for multimedia data.
In one aspect, a computer-readable storage medium having at least one program code stored therein is loaded and executed by a processor to implement operations performed by a play control method for multimedia data.
In one aspect, a computer program product is provided, the computer program product comprising computer code that is loaded and executed by a processor of a terminal to implement operations performed by a play control method of the multimedia data.
According to the scheme provided by the application, the user can draw the graph on the playing interface of the target multimedia data, and then based on the graph drawn by the user, the target multimedia data is played in a playing control mode corresponding to the graph, so that the diversity of the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram of an implementation environment of a method for controlling playing of multimedia data according to an embodiment of the present application;
fig. 2 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
fig. 3 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a user drawn graph provided in an embodiment of the present application;
fig. 5 is an interface schematic diagram of a playing interface of multimedia data according to an embodiment of the present application;
fig. 6 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a user drawn graph provided in an embodiment of the present application;
FIG. 8 is a schematic diagram of a user drawn graph provided in an embodiment of the present application;
fig. 9 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
FIG. 10 is a schematic diagram of a user drawn graph provided in an embodiment of the present application;
fig. 11 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
FIG. 12 is a schematic illustration of a user drawn graphic provided in an embodiment of the present application;
Fig. 13 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application;
fig. 14 is a schematic structural diagram of a playback control device for multimedia data according to an embodiment of the present application;
fig. 15 is a schematic structural diagram of a terminal according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
Fig. 1 is a schematic implementation environment diagram of a method for controlling playing of multimedia data according to an embodiment of the present application, referring to fig. 1, the implementation environment includes: a terminal 101 and a server 102.
The terminal 101 is at least one of a smart phone, a tablet computer, an electronic book reader, an MP3 (Moving Picture Experts Group Audio Layer III, moving picture experts compression standard audio layer 3) player, an MP4 (Moving Picture Experts Group Audio Layer IV, moving picture experts compression standard audio layer 4) player, and a laptop portable computer. The terminal 101 and the server 102 are connected by wired or wireless communication, which is not limited in the embodiment of the present application. The terminal 101 is installed and runs multimedia data playing software (such as a video player, etc.), and the terminal 101 can acquire multimedia data from the server 102, or acquire multimedia data from a local storage of the terminal 101, and play the multimedia data based on the acquired multimedia data, so that a user can view the multimedia data through the terminal 101.
Terminal 101 refers broadly to one of a plurality of terminals, and the embodiments of the present application are illustrated with terminal 101 only. Those skilled in the art will appreciate that in many more possible implementations, the number of terminals described above is greater or lesser. For example, the number of the terminals is only several, or the number of the terminals is tens or hundreds, or more, and the number and the device type of the terminal 101 are not limited in the embodiment of the present application.
Server 102 is at least one of a server, a plurality of servers, a cloud computing platform, and a virtualization center. The server 102 and the terminal 101 are connected by wired or wireless communication, which is not limited in the embodiment of the present application. The server 102 is associated with a multimedia database for storing a plurality of multimedia data, so that when the terminal 101 wants to acquire multimedia data, corresponding multimedia data is acquired from the multimedia database, and the acquired multimedia data is further sent to the terminal 101, so that the terminal 101 plays based on the acquired multimedia data. Alternatively, the number of the servers is greater or lesser, which is not limited by the embodiment of the present application. Of course, in more possible implementations, the server 102 also includes other functional servers in order to provide more comprehensive and diversified services.
Fig. 2 is a flowchart of a method for controlling playing of multimedia data according to an embodiment of the present application, referring to fig. 2, the method includes:
201. the terminal displays a graphic generated based on a drawing operation in response to the drawing operation at a playback interface of the target multimedia data.
In one possible implementation manner, the terminal plays the target multimedia data on the playing interface, and in the playing process of the target multimedia data, the user can perform drawing operation on the playing interface, and the terminal responds to the drawing operation of the user on the playing interface to display the graph drawn by the user.
Optionally, the multimedia data is video, or the multimedia data is audio, or the multimedia data is of another type, which is not limited in the embodiments of the present application. The pattern may be a segmented pattern (e.g., rectangular, line segment, etc.), a circular ring, a double-speed pattern (e.g., polygonal, etc.), etc., or may be another type, which is not limited in the embodiments of the present application.
In the process of playing the target multimedia data, when the terminal starts playing the target multimedia data, the terminal can acquire the drawing operation performed by the user on the playing interface, namely, after the terminal starts playing the target multimedia data, the user can perform the drawing operation on the playing interface at any time, and the terminal can respond to the drawing operation of the user to display the graph generated based on the drawing operation.
Or when the target multimedia data is played for a preset time length, the terminal displays prompt information, the prompt information is used for prompting that the time for carrying out the drawing operation is reached, and after the user sees the prompt information, the user can carry out the drawing operation in the playing interface, so that the terminal can respond to the drawing operation of the user and display a graph generated based on the drawing operation.
By providing two selectable graphics rendering opportunities, the flexibility of rendering operations and thus the flexibility of multimedia data playback processes can be improved. Furthermore, the two graphics rendering opportunities referred to above are merely two exemplary illustrations, and in many more possible implementations, many more alternative opportunities are possible, and the embodiments of the present application are not limited thereto.
In addition, when playing the target multimedia data, the terminal can display operation guide information on a playing interface of the target multimedia data, the operation guide information is used for guiding a user to draw the graph, the user can know how to draw the graph on the playing interface after seeing the operation guide information, so that the user can smoothly conduct drawing operation, and the terminal can respond to the drawing operation of the user to display the graph generated based on the drawing operation.
The operation guide information is displayed on the playing interface, so that a user can draw a graph based on the operation guide information displayed on the playing interface, the playing control of the multimedia data is realized, and the intelligence of the playing process of the multimedia data is improved.
For the process of drawing the graphics on the playing interface by the user, in one possible implementation manner, a transparent layer is arranged on the upper layer of the playing interface, the user performs drawing operation on the playing interface, that is, performs drawing operation on the transparent layer, and the terminal responds to the drawing operation of the user to display the graphics generated based on the drawing operation.
In another possible implementation, the playback interface includes a graphic rendering area in which the terminal plays the target multimedia data, and a playback area in which the user can perform a rendering operation, and the terminal displays a graphic generated based on the rendering operation in response to the rendering operation in the graphic rendering area.
The specific positions of the graphics rendering area and the playing area are not limited, for example, the playing area is located at the left side of the graphics rendering area, or the graphics rendering area is located below the playing area, or the graphics rendering area is located at the lower left corner of the playing area, or the like.
It should be noted that the foregoing is merely two exemplary manners, and is not meant to limit the application, and in more possible implementations, the process of drawing the graphic on the playing interface by the user is implemented in other manners, which is not limited in the embodiments of the present application.
202. The terminal determines the playing control mode corresponding to the graph.
Different graphics correspond to different play control modes, and the corresponding relation between each graphic and the play control mode is prestored in the terminal, so that after the graphic drawn by the user is determined, the terminal can determine the corresponding play control mode based on the graphic drawn by the user.
203. And the terminal plays the target multimedia data based on the play control mode.
According to the scheme provided by the embodiment of the application, the user can draw the graph on the playing interface of the target multimedia data, and then based on the graph drawn by the user, the target multimedia data is played in a playing control mode corresponding to the graph, so that the diversity of the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
The foregoing fig. 2 is merely a basic flow of the present application, and the solution provided in the present application will be further described below based on several specific implementation procedures. First, when the graphics drawn by the user are segment graphics that do not overlap each other, the corresponding play control process refers to fig. 3, and fig. 3 is a flowchart of a play control method of multimedia data according to an embodiment of the present application, where the method includes:
301. The terminal displays a graphic generated based on a drawing operation in response to the drawing operation at a playback interface of the target multimedia data.
This step is similar to step 201 described above and will not be described again here.
302. And determining the playing control mode of the target multimedia data as the segmented playing by the terminal under the condition that the graph is a plurality of segmented graphs.
In one possible implementation manner, when determining that the graphic drawn by the user is a plurality of segment graphics, the terminal determines that the play control mode corresponding to the plurality of segment graphics is segment play according to the corresponding relationship between the stored graphic and the play control mode, thereby determining that the play control mode of the target multimedia data is segment play.
The segment graphics are rectangular or line segments, or the segment graphics are of other types, which are not limited in the embodiments of the present application.
Taking the sectional graph as a rectangle as an example, referring to fig. 4, fig. 4 is a schematic diagram of a graph drawn by a user according to an embodiment of the present application, and as shown in fig. 4, the user draws 4 rectangles with the same size, and at this time, the terminal can determine that the playing control mode is the sectional playing based on the 4 rectangles drawn by the user.
303. In the case where the plurality of segment patterns do not overlap each other, the terminal determines a length ratio of each segment pattern.
Wherein the plurality of segment patterns do not overlap each other, that is, any two segment patterns do not completely overlap each other among the plurality of segment patterns. For the length proportion of each segment graph, if the segment graph is a line segment, the length proportion of each segment graph, namely the length proportion of each line segment; if the segment graphics are rectangular, and the sides of the rectangle include length and width, the length ratio of each segment graphics, that is, the length ratio corresponding to the long side of each rectangle, and for other types of segment graphics, the determination manner of the length ratio of each segment graphics is the same as the above process, and will not be repeated here.
Still taking fig. 4 as an example, the 4 rectangles in fig. 4 do not overlap with each other, and at this time, the terminal determines that the lengths of the rectangles are the same, that is, the length ratio of the rectangles is 1:1:1:1.
In the above fig. 4 is merely an exemplary graph, in further possible implementations, the lengths of the rectangles drawn by the user are not completely the same, for example, the length ratio of each rectangle is 1:2:1:1, or the length ratio is another value, which is not limited in this embodiment of the present application.
304. The terminal segments the target multimedia data into a plurality of multimedia fragments based on the length proportion of each segment graph and the playing time length of the target multimedia data.
In one possible implementation manner, after determining the length proportion of each segment graph, the terminal determines the playing time length of each multimedia segment to be segmented based on the length proportion of each segment graph and the playing time length of the target multimedia data, so that the target multimedia data is segmented into a plurality of multimedia segments based on the determined playing time length.
Still taking fig. 4 as an example, after determining that the length ratio of each rectangle is 1:1:1, if the playing duration of the target multimedia data is 20 seconds, the terminal determines that the playing duration of each multimedia segment to be segmented is 5 seconds, so as to segment the target multimedia data into 4 multimedia segments of 0-5 seconds, 5-10 seconds, 10-15 seconds and 15-20 seconds.
In addition, if the terminal determines that the length ratio of each segment graphic is 1:2:1:1 and the playing duration of the target multimedia data is 20 seconds, the terminal determines that the playing duration of each multimedia segment to be segmented is 4 seconds, 8 seconds, 4 seconds and 4 seconds respectively, so that the target multimedia data is segmented into 4 multimedia segments of 0-4 seconds, 4-12 seconds, 12-16 seconds and 16-20 seconds.
The step 304 of dividing the target multimedia data into a plurality of multimedia segments refers to dividing the playing duration of the target multimedia data into a plurality of time intervals, so as to obtain the multimedia segments corresponding to different time intervals, and not dividing the multimedia file corresponding to the target multimedia data into a plurality of multimedia segment files.
The segment patterns and the length ratios of the segment patterns mentioned in the steps 302 to 304 are all exemplary descriptions, and are not meant to limit the present application.
305. And the terminal plays any one of the plurality of multimedia fragments on the playing interface, wherein the playing interface comprises a switching control.
In one possible implementation manner, the terminal randomly selects any one multimedia segment from the multiple multimedia segments obtained by segmentation, and plays the any one multimedia segment. Optionally, the terminal automatically plays the first multimedia segment after splitting the target multimedia data into the plurality of multimedia segments.
The playing interface comprises a switching control, and the switching control is used for realizing switching of the multimedia fragments played by the playing interface when triggered. Referring to fig. 5, fig. 5 is an interface schematic diagram of a playing interface provided in the embodiment of the present application, and a button 501 is the switching control.
306. And the terminal responds to the triggering operation of the switching control and plays the next multimedia fragment corresponding to any one multimedia fragment.
In one possible implementation manner, in the playing process of any multimedia segment, the user can trigger the switching control, and the terminal responds to the triggering operation of the switching control to switch the multimedia segment played by the playing interface to the next multimedia segment corresponding to any currently played multimedia segment.
Taking the playing interface shown in fig. 5 as an example, if in the playing interface shown in fig. 5, the currently played multimedia clip is the first multimedia clip and the user triggers the button 501, the terminal responds to the triggering operation of the button 501 to switch the currently played multimedia clip to the second multimedia clip.
In more possible implementation manners, if the user does not trigger the switch control in the playing process of any one of the multimedia fragments, the terminal automatically plays the next multimedia fragment corresponding to the any one of the multimedia fragments when the playing of the any one of the multimedia fragments is finished.
When the playing of the multimedia fragments played by the playing interface is finished, the next multimedia fragment is automatically played without manual operation of a user, so that the man-machine interaction efficiency is improved, and the intelligence of the multimedia data playing process is improved.
According to the scheme provided by the embodiment of the application, the user can draw the mutually non-overlapping multiple segment graphics on the playing interface of the target multimedia data, and then divide the target multimedia data into multiple multimedia fragments based on the mutually non-overlapping multiple segment graphics drawn by the user, so that the multiple multimedia fragments obtained by dividing are played one by one, the playing of the target multimedia data is realized, the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved. And a switching control is provided on the playing interface, so that a user can switch among a plurality of multimedia fragments through the switching control, the operation is simple and convenient, the man-machine interaction efficiency is improved, and the user experience is improved.
The process shown in fig. 3 is only a playing control process of multimedia data corresponding to when the graphics drawn by the user are segment graphics that do not overlap each other, and when the graphics drawn by the user are segment graphics that intersect each other, the corresponding playing control process is referred to fig. 6, and fig. 6 is a flowchart of a playing control method of multimedia data provided by an embodiment of the present application, where the method includes:
601. The terminal displays a graphic generated based on a drawing operation in response to the drawing operation at a playback interface of the target multimedia data.
This step is similar to step 201 described above and will not be described again here.
602. And determining the playing control mode of the target multimedia data as the segmented playing by the terminal under the condition that the graph is a plurality of segmented graphs.
In one possible implementation manner, when determining that the graphic drawn by the user is a plurality of segment graphics, the terminal determines that the play control mode corresponding to the plurality of segment graphics is segment play according to the corresponding relationship between the stored graphic and the play control mode, thereby determining that the play control mode of the target multimedia data is segment play.
The segment graphics are rectangular or line segments, or the segment graphics are of other types, which are not limited in the embodiments of the present application.
Taking the sectional graph as a rectangle as an example, referring to fig. 7, fig. 7 is a schematic diagram of a graph drawn by a user according to the embodiment of the present application, and as shown in fig. 7, the user draws 2 rectangles with the same size, and at this time, the terminal can determine that the playing control mode is the sectional playing based on the 2 rectangles drawn by the user.
603. In the case where the plurality of segment patterns intersect, the terminal determines a length ratio of each segment pattern.
If the segment patterns are rectangles, the multiple segment patterns intersect, that is, the multiple rectangles intersect, and for any two rectangles in the multiple rectangles, straight lines are collinear inside the any two rectangles, or the any two rectangles intersect in a line segment, and the line segment is located inside the two rectangles. The sides of the rectangle comprise length and width, and the length proportion of each segmented graph is the length proportion corresponding to the long side of each rectangle.
If the segment pattern is a line segment, the plurality of segment patterns intersect, that is, the plurality of line segments intersect, and for any two line segments of the plurality of line segments, the any two line segments intersect at a point. The length ratio of each segment graph is the length ratio corresponding to the length of each line segment.
Still taking fig. 7 as an example, the 2 rectangles in fig. 7 intersect at the line segment AB, and at this time, the terminal determines that the lengths of the rectangles are all the same, that is, the length ratio of the rectangles is 1:1.
In the above fig. 7 is merely an exemplary graph, in further possible implementations, the lengths of the rectangles drawn by the user are not completely the same, for example, the length ratio of each rectangle is 2:3, or the length ratio is another value, which is not limited in this embodiment of the present application.
604. The terminal segments the target multimedia data into a plurality of multimedia fragments based on the length proportion of each segment graph and the playing time length of the target multimedia data.
In one possible implementation manner, after determining the length proportion of each segment graph, the terminal determines the playing time length of each multimedia segment to be segmented based on the length proportion of each segment graph and the playing time length of the target multimedia data, so that the target multimedia data is segmented into a plurality of multimedia segments based on the determined playing time length.
Still taking fig. 7 as an example, after determining that the length ratio of each rectangle is 1:1, if the playing duration of the target multimedia data is 20 seconds, the terminal determines that the playing duration of each multimedia segment to be segmented is 10 seconds, so as to segment the target multimedia data into 2 multimedia segments of 0-10 seconds and 10-20 seconds.
In addition, if the terminal determines that the length ratio of each segment graph is 2:3 and the playing time length of the target multimedia data is 20 seconds, the terminal determines that the playing time length of each multimedia segment to be segmented is 8 seconds and 12 seconds respectively, so that the target multimedia data is segmented into 2 multimedia segments of 0-8 seconds and 8-20 seconds.
605. And the terminal determines the intersecting position of each segment graph as the target moment in each multimedia segment.
In one possible implementation, if the locations of the intersections of the segment patterns are all located at the midpoints of the segment patterns, the terminal determines the target time in each multimedia segment based on the locations of the intersections of the segment patterns.
Taking fig. 7 as an example, in fig. 7, the two rectangles intersect at the line segment AB, and the point a and the point B are both located at the middle point of the two rectangles, and in combination with the above-mentioned step 604, the terminal segments the target multimedia data into two multimedia segments of 0-10 seconds and 10-20 seconds, the target time in the multimedia segment of 0-10 seconds is 5 th second, and the target time in the multimedia segment of 10-20 seconds is 15 th second.
In another possible implementation manner, if there is a position where any two segment graphics intersect, and not at the midpoint of the any two segment graphics, the terminal obtains the drawing sequence of the plurality of segment graphics, and further determines the target time in each multimedia segment based on the drawing sequence of each segment graphics and the position where each segment graphics intersect.
Taking a sectional graph drawn by a user as a rectangle as an example, referring to fig. 8, fig. 8 is a schematic diagram of a graph drawn by a user provided in this embodiment of the present application, as shown in fig. 8, the length ratio of the rectangle ABCD to the rectangle EFGH is 1:1, the rectangle ABCD and the rectangle EFGH intersect at a line segment IJ, the point I and the point J are located at 1/5 position of the rectangle ABCD, the point I and the point J are located at the midpoint of the rectangle EFGH, the terminal cuts the target multimedia data into two multimedia segments of 0 to 10 seconds and 10 to 20 seconds in combination with the above step 604, if the rectangle ABCD is drawn first, and then the rectangle EFGH is drawn, the target time in the multimedia segment of 0 to 10 seconds is 2 seconds, and the target time in the multimedia segment of 10 to 20 seconds is 15 seconds.
Or, in more possible implementations, no matter where the position of each segment graphic is located in the segment graphic, the terminal obtains the drawing sequence of the plurality of segment graphics, and determines the target time in each multimedia segment based on the drawing sequence of each segment graphic and the position of each segment graphic.
By providing the above several possible ways of determining the target moment, the diversity of the multimedia data processing process is increased, thereby improving the flexibility in the multimedia data processing process.
The segment patterns, the length ratios of the segment patterns, and the intersecting positions of the segment patterns mentioned in the above steps 602 to 305 are all exemplary descriptions, and are not limiting of the present application.
606. And the terminal plays any one of the plurality of multimedia fragments on the playing interface, wherein the playing interface comprises a switching control.
This step 606 is similar to the step 305 described above, and will not be described again.
607. And when the target time in any one of the multimedia fragments is played, the terminal responds to the triggering operation of the switching control, and plays the next multimedia fragment from the target time in the next multimedia fragment corresponding to the any one of the multimedia fragments.
In one possible implementation manner, during the playing process of any one multimedia segment, the user can trigger the switching control, and if the user triggers the switching control when any one multimedia segment is played to the target moment, the terminal responds to the triggering operation of the switching control, and in the playing interface, the next multimedia segment is played from the target moment of the next multimedia segment corresponding to any one currently played multimedia segment.
Taking the playing interface shown in fig. 5 as an example, if the graphic drawn by the user on the playing interface is shown in fig. 7, and in the playing interface shown in fig. 5, the currently played multimedia clip is the first multimedia clip, when the first multimedia clip is played for the 5 th second, the user triggers the button 501, and the terminal responds to the triggering operation of the button 501 to play the second multimedia clip from the 15 th second of the second multimedia clip.
Taking the playing interface shown in fig. 5 as an example, if the graphic drawn by the user on the playing interface is shown in fig. 8, and in the playing interface shown in fig. 5, the currently played multimedia clip is the first multimedia clip, when the first multimedia clip is played for 2 seconds, the user triggers the button 501, and the terminal responds to the triggering operation of the button 501, and plays the second multimedia clip from 15 seconds of the second multimedia clip.
In addition, if the user triggers the switching control at a time other than the target time, the terminal responds to the triggering operation of the switching control, and starts from the 0 th second of the next multimedia segment corresponding to the currently played multimedia segment, and plays the next multimedia segment.
In more possible implementation manners, if the user does not trigger the switch control in the playing process of any one of the multimedia fragments, the terminal automatically plays the next multimedia fragment corresponding to the any one of the multimedia fragments when the playing of the any one of the multimedia fragments is finished.
When the playing of the multimedia fragments played by the playing interface is finished, the next multimedia fragment is automatically played without manual operation of a user, so that the man-machine interaction efficiency is improved, and the intelligence of the multimedia data playing process is improved.
According to the scheme provided by the embodiment of the application, the user can draw the intersected multiple segment graphics on the playing interface of the target multimedia data, and then the target multimedia data is segmented into multiple multimedia fragments based on the intersected multiple segment graphics drawn by the user, so that the multiple multimedia fragments obtained by segmentation are played one by one, the playing of the target multimedia data is realized, the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved. And moreover, a switching control is provided on the playing interface, so that a user can realize jump type switching among a plurality of multimedia fragments by triggering the switching control when playing to a target moment corresponding to the intersecting position, the operation is simple and convenient, and the human-computer interaction efficiency is improved, thereby improving the user experience.
The process shown in fig. 6 is only a play control process corresponding to when the graphic drawn by the user is an intersecting segment graphic, and when the graphic drawn by the user is a ring, the corresponding play control process is referred to fig. 9, and fig. 9 is a flowchart of a play control method of multimedia data according to an embodiment of the present application, where the method includes:
901. the terminal displays a graphic generated based on a drawing operation in response to the drawing operation at a playback interface of the target multimedia data.
This step is similar to step 201 described above and will not be described again here.
902. And under the condition that the graph is a circular ring, the terminal determines the playing control mode of the target multimedia data as cyclic playing.
In one possible implementation manner, when determining that the graphic drawn by the user is a circular ring, the terminal determines that the playing control mode corresponding to the circular ring is circular playing according to the corresponding relation between the stored graphic and the playing control mode, so that the playing control mode of the target multimedia data is determined to be circular playing.
Referring to fig. 10, fig. 10 is a schematic diagram of a graph drawn by a user according to an embodiment of the present application, where, as shown in fig. 10, the graph drawn by the user is a ring, and at this time, the terminal can determine that the play control mode is circular play based on the ring drawn by the user.
903. And when the playing of the target multimedia data is finished, the terminal starts to play the target multimedia data from the head.
For example, if the playing duration of the target multimedia data is 20 seconds, the terminal starts playing the target multimedia data from the 0 th second of the target multimedia data when the 20 th second of the target multimedia data is played.
In more possible implementations, the target multimedia data is provided with a threshold number of loops, and when the number of plays of the target multimedia data is smaller than the threshold number of loops, the terminal can play the target multimedia data from the beginning each time the play of the target multimedia data is finished. And stopping playing the target multimedia data by the terminal when the playing times of the target multimedia data are equal to the threshold value of the cycle times.
The cycle number threshold is preset by a developer of the multimedia data playing software, or preset by a publisher (or producer) of the target multimedia data, or preset by a user watching the target multimedia data, which is not limited in the embodiment of the present application.
By setting the threshold value of the circulation times for the target multimedia data, the situation of infinite circulation play of the target multimedia data is avoided, and the intelligence of the multimedia data playing process is improved.
According to the scheme provided by the embodiment of the application, the user can draw the circular ring on the playing interface of the target multimedia data, and then based on the circular ring drawn by the user, the playing control mode of the target multimedia data is determined to be circular playing, so that the target multimedia data is circularly played, the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
The process shown in fig. 9 is only a play control process corresponding to a case where a graphic drawn by a user is a ring, and when the graphic drawn by the user is a double-speed graphic, the corresponding play control process is referred to fig. 11, and fig. 11 is a flowchart of a play control method of multimedia data according to an embodiment of the present application, where the method includes:
1101. the terminal displays a graphic generated based on a drawing operation in response to the drawing operation at a playback interface of the target multimedia data.
This step is similar to step 201 described above and will not be described again here.
1102. And under the condition that the graph is a double-speed graph, the terminal determines the playing control mode of the target multimedia data as cyclic playing.
In one possible implementation manner, when determining that the graphic drawn by the user is a double-speed graphic, the terminal determines that the playing control mode corresponding to the double-speed graphic is double-speed playing according to the corresponding relation between the stored graphic and the playing control mode, so as to determine that the playing control mode of the target multimedia data is double-speed playing.
The double-speed pattern is a polygon, or the double-speed pattern is of other types, which is not limited in the embodiment of the present application.
Taking the double-speed graph as a polygon as an example, referring to fig. 12, fig. 12 is a schematic diagram of a graph drawn by a user according to an embodiment of the present application, where, as shown in fig. 12, the graph drawn by the user is a polygon, and at this time, the terminal can determine that the play control mode is double-speed play based on the polygon drawn by the user.
1103. The terminal determines the playing speed of the target multimedia data based on the number of edges of the double-speed graph.
Still taking fig. 12 as an example, the double-speed graph drawn by the user is a hexagon, that is, the number of sides of the double-speed graph drawn by the user is 6, and the terminal determines the playing speed of the target multimedia data to be 6 based on the number of sides of the hexagon.
1104. And the terminal plays the target multimedia data according to the playing speed of the target multimedia data.
Still taking fig. 12 as an example, as shown in fig. 12, the double-speed graph drawn by the user is hexagonal, and accordingly, the playing speed of the target multimedia data is 6, and when the target multimedia data is played, the terminal plays the target multimedia data at six times speed.
According to the scheme provided by the embodiment of the application, the user can draw the multiple-speed graph such as a polygon on the playing interface of the target multimedia data, and then based on the multiple-speed graph drawn by the user, the playing control mode of the target multimedia data is determined to be multiple-speed playing, and further based on the number of edges of the multiple-speed graph, the target multimedia data is played at the corresponding multiple-speed, the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
The process shown in fig. 11 is only a play control process corresponding to a case where a graphic drawn by a user is a double-speed graphic, and when the graphic drawn by the user is an arrow pointing to the left, the corresponding play control process is referred to fig. 13, and fig. 13 is a flowchart of a play control method of multimedia data according to an embodiment of the present application, where the method includes:
1301. the terminal displays a graphic generated based on a drawing operation in response to the drawing operation at a playback interface of the target multimedia data.
This step is similar to step 201 described above and will not be described again here.
1302. In the case where the graphic is an arrow and the arrow points to the left, the terminal determines the play control manner of the target multimedia data as reverse play.
In one possible implementation manner, when determining that the graphic drawn by the user is an arrow and the arrow points to the left, the terminal determines that the playing control mode corresponding to the arrow pointing to the left is reverse playing according to the corresponding relation between the stored graphic and the playing control mode, so that the playing control mode of the target multimedia data is determined to be reverse playing.
1303. And the terminal plays the target multimedia data in reverse order from the moment when the target multimedia data is currently played.
For example, if the target multimedia data is currently played to 10 th second, the terminal plays the target multimedia data forward from 10 th second, that is, plays 9 th second, then plays 8 th second, 7 th second, … …, and so on until playing to 0 th second.
According to the scheme provided by the embodiment of the application, the arrow pointing to the left side can be drawn on the playing interface of the target multimedia data by the user, and then the playing control mode of the target multimedia data is determined to be reverse playing based on the arrow pointing to the left side drawn by the user, so that the target multimedia data is played in reverse order, the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
All the above optional solutions can be combined to form an optional embodiment of the present application, which is not described in detail herein.
Fig. 14 is a schematic structural diagram of a playback control device for multimedia data according to an embodiment of the present application, referring to fig. 14, the device includes:
a display module 1401 for displaying a graphic generated based on a drawing operation in response to the drawing operation at a playback interface of the target multimedia data;
a determining module 1402, configured to determine a play control mode corresponding to the graphic;
a playing module 1403, configured to play the target multimedia data based on the play control mode.
According to the device provided by the embodiment of the application, the user can draw the graph on the playing interface of the target multimedia data, and then based on the graph drawn by the user, the target multimedia data is played in the playing control mode corresponding to the graph, so that the diversity of the playing control mode in the playing process of the multimedia data is increased, and the flexibility and the intelligence of the playing of the multimedia data are improved.
In a possible implementation manner, the determining module 1402 is configured to determine the play control manner as a segment play when the graphic is a plurality of segment graphics; determining the length proportion of each segment graph under the condition that the segment graphs are not overlapped with each other; dividing the target multimedia data into a plurality of multimedia fragments based on the length proportion of each segmented graph and the playing time length of the target multimedia data; wherein the segmentation graphic comprises a rectangle or a line segment.
In one possible implementation, the playing module 1403 is configured to play any one of the plurality of multimedia clips at the playing interface, where the playing interface includes a switch control; and responding to the triggering operation of the switching control, and playing the next multimedia fragment corresponding to any one multimedia fragment.
In a possible implementation manner, the determining module 1402 is configured to determine the play control manner as a segment play when the graphic is a plurality of segment graphics; determining the length proportion of each segment graph under the condition that the plurality of segment graphs intersect; dividing the target multimedia data into a plurality of multimedia fragments based on the length proportion of each segmented graph and the playing time length of the target multimedia data; a target time in each multimedia segment is determined based on the location at which each segment graphic intersects.
In one possible implementation, the playing module 1403 is configured to play any one of the plurality of multimedia clips at the playing interface, where the playing interface includes a switch control; and when the target moment in any one of the multimedia fragments is played, responding to the triggering operation of the switching control, and starting to play the next multimedia fragment from the target moment in the next multimedia fragment corresponding to the any one of the multimedia fragments.
In a possible implementation manner, the determining module 1402 is configured to determine the playback control manner as a circular playback in a case where the graphic is a circular ring.
In a possible implementation manner, the determining module 1402 is configured to determine the play control mode as a double-speed play when the graphic is a double-speed graphic; determining the playing speed of the target multimedia data based on the number of edges of the double-speed graph; wherein the multiple speed pattern comprises a polygon.
In a possible implementation manner, the determining module 1402 is configured to determine the playback control manner as reverse playback in a case where the graphic is an arrow and the arrow points to the left.
It should be noted that: the play control device for multimedia data provided in the above embodiment only illustrates the division of the above functional modules when controlling the play of the target multimedia data, and in practical application, the above functional allocation is performed by different functional modules according to needs, i.e. the internal structure of the terminal is divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus for controlling playing of multimedia data provided in the foregoing embodiments and the method embodiment for controlling playing of multimedia data belong to the same concept, and detailed implementation processes of the apparatus and the method embodiment are detailed and will not be described herein.
Fig. 15 is a schematic structural diagram of a terminal according to an embodiment of the present application. The terminal 1500 is: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion picture expert compression standard audio plane 3), an MP4 (Moving Picture Experts Group Audio Layer IV, motion picture expert compression standard audio plane 4) player, a notebook computer, or a desktop computer. Terminal 1500 can also be referred to as a user device, portable terminal, laptop terminal, desktop terminal, and the like.
In general, the terminal 1500 includes: one or more processors 1501 and one or more memories 1502.
The processor 1501 includes one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 1501 is implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array ). The processor 1501 includes a main processor, which is a processor for processing data in an awake state, also called a CPU (Central Processing Unit ), and a coprocessor; a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 1501 is integrated with a GPU (Graphics Processing Unit, image processor) for taking care of rendering and drawing of content to be displayed by the display screen. In some embodiments, the processor 1501 further includes an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.
The memory 1502 includes one or more computer-readable storage media that, in one possible implementation, are non-transitory. Memory 1502 also includes high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in the memory 1502 is configured to store at least one program code for execution by the processor 1501 to implement the playback control method of multimedia data provided by the method embodiments in the present application.
In some embodiments, the terminal 1500 may further optionally include: a peripheral interface 1503 and at least one peripheral device. The processor 1501, memory 1502 and peripheral interface 1503 are connected by bus or signal lines. The respective peripheral devices are connected to the peripheral device interface 1503 through buses, signal lines, or circuit boards. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1504, a display screen 1505, a camera assembly 1506, audio circuitry 1507, a positioning assembly 1508, and a power supply 1509.
A peripheral interface 1503 may be used to connect I/O (Input/Output) related at least one peripheral device to the processor 1501 and the memory 1502. In some embodiments, processor 1501, memory 1502, and peripheral interface 1503 are integrated on the same chip or circuit board; in some other embodiments, either or both of the processor 1501, the memory 1502, and the peripheral interface 1503 can be implemented on a separate chip or circuit board, which is not limited in this embodiment.
The Radio Frequency circuit 1504 is configured to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1504 communicates with a communication network and other communication devices via electromagnetic signals. The radio frequency circuit 1504 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1504 includes: antenna systems, RF transceivers, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, subscriber identity module cards, and so forth. The radio frequency circuit 1504 communicates with other terminals via at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: metropolitan area networks, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity ) networks. In some embodiments, the radio frequency circuit 1504 further includes NFC (Near Field Communication ) related circuitry, which is not limited in this application.
Display 1505 is used to display a UI (User Interface). The UI includes graphics, text, icons, video, and any combination thereof. When display screen 1505 is a touch display screen, display screen 1505 also has the ability to collect touch signals at or above the surface of display screen 1505. The touch signal can be input to the processor 1501 as a control signal for processing. At this point, display 1505 can also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, display 1505 is one and disposed on the front panel of terminal 1500; in other embodiments, the display 1505 is at least two, and is respectively disposed on different surfaces of the terminal 1500 or in a folded design; in other embodiments, display 1505 is a flexible display that is disposed on a curved surface or folded surface of terminal 1500. Even more, the display 1505 is arranged in a non-rectangular irregular pattern, i.e. a shaped screen. The display screen 1505 is made of LCD (Liquid Crystal Display ), OLED (Organic Light-Emitting Diode) or other materials.
The camera assembly 1506 is used to capture images or video. Optionally, the camera assembly 1506 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal and the rear camera is disposed on the rear surface of the terminal. In some embodiments, the at least two rear cameras are any one of a main camera, a depth camera, a wide-angle camera and a tele camera, so as to realize that the main camera and the depth camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize a panoramic shooting and Virtual Reality (VR) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1506 also includes a flash. Alternatively, the flash is a single-color temperature flash, or a dual-color temperature flash. The dual-color temperature flash lamp refers to a combination of a warm light flash lamp and a cold light flash lamp, and can be used for light compensation under different color temperatures.
The audio circuitry 1507 includes a microphone and a speaker. The microphone is used for collecting sound waves of users and the environment, converting the sound waves into electric signals, inputting the electric signals to the processor 1501 for processing, or inputting the electric signals to the radio frequency circuit 1504 for voice communication. For the purpose of stereo acquisition or noise reduction, a plurality of microphones are respectively disposed at different positions of the terminal 1500. Optionally, the microphone is an array microphone or an omni-directional pickup microphone. The speaker is used to convert electrical signals from the processor 1501 or the radio frequency circuit 1504 into sound waves. Alternatively, the speaker is a conventional thin film speaker, or alternatively, the speaker is a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only the electric signal can be converted into a sound wave audible to humans, but also the electric signal can be converted into a sound wave inaudible to humans for ranging and other purposes. In some embodiments, the audio circuit 1507 also includes a headphone jack.
The positioning component 1508 is for positioning a current geographic location of the terminal 1500 to enable navigation or LBS (Location Based Service, location-based services). The positioning component 1508 is a positioning component based on the United states GPS (Global Positioning System ), the Beidou system of China, the Granati system of Russia, or the Galileo system of the European Union.
The power supply 1509 is used to power the various components in the terminal 1500. The power supply 1509 is an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1509 includes a rechargeable battery, the rechargeable battery can support wired or wireless charging. The rechargeable battery can also be used to support fast charge technology.
In some embodiments, the terminal 1500 also includes one or more sensors 1510. The one or more sensors 1510 include, but are not limited to: acceleration sensor 1511, gyroscope sensor 1512, pressure sensor 1513, fingerprint sensor 1514, optical sensor 1515, and proximity sensor 1516.
The acceleration sensor 1511 is capable of detecting the magnitudes of accelerations on three coordinate axes of the coordinate system established with the terminal 1500. For example, the acceleration sensor 1511 can be used to detect components of gravitational acceleration on three coordinate axes. The processor 1501 can control the display screen 1505 to display the user interface in either a landscape view or a portrait view based on the gravitational acceleration signal acquired by the acceleration sensor 1511. The acceleration sensor 1511 can also be used for acquisition of motion data of a game or a user.
The gyro sensor 1512 can detect the body direction and the rotation angle of the terminal 1500, and the gyro sensor 1512 can acquire the 3D motion of the user on the terminal 1500 in cooperation with the acceleration sensor 1511. The processor 1501, based on the data collected by the gyro sensor 1512, can implement the following functions: motion sensing (e.g., changing UI according to a tilting operation by a user), image stabilization at shooting, game control, and inertial navigation.
Pressure sensor 1513 is disposed on the side frame of terminal 1500 and/or below display 1505. When the pressure sensor 1513 is disposed on the side frame of the terminal 1500, a grip signal of the user on the terminal 1500 can be detected, and the processor 1501 performs left-right hand recognition or quick operation according to the grip signal collected by the pressure sensor 1513. When the pressure sensor 1513 is disposed at the lower layer of the display screen 1505, the processor 1501 realizes control of the operability control on the UI interface according to the pressure operation of the user on the display screen 1505. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.
The fingerprint sensor 1514 is used for collecting the fingerprint of the user, and the processor 1501 recognizes the identity of the user according to the collected fingerprint of the fingerprint sensor 1514, or the fingerprint sensor 1514 recognizes the identity of the user according to the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the processor 1501 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying for and changing settings, etc. Optionally, a fingerprint sensor 1514 is provided on the front, back or side of the terminal 1500. When a physical key or vendor Logo is provided on the terminal 1500, the fingerprint sensor 1514 is integrated with the physical key or vendor Logo.
The optical sensor 1515 is used to collect the ambient light intensity. In one embodiment, processor 1501 can control the display brightness of display screen 1505 based on the intensity of ambient light collected by optical sensor 1515. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1505 is turned up; when the ambient light intensity is low, the display luminance of the display screen 1505 is turned down. In another embodiment, the processor 1501 is also capable of dynamically adjusting the capture parameters of the camera assembly 1506 based on the intensity of ambient light collected by the optical sensor 1515.
A proximity sensor 1516, also referred to as a distance sensor, is typically provided on the front panel of the terminal 1500. The proximity sensor 1516 is used to collect the distance between the user and the front of the terminal 1500. In one embodiment, when the proximity sensor 1516 detects a gradual decrease in the distance between the user and the front of the terminal 1500, the processor 1501 controls the display 1505 to switch from the on-screen state to the off-screen state; when the proximity sensor 1516 detects that the distance between the user and the front surface of the terminal 1500 gradually increases, the processor 1501 controls the display screen 1505 to switch from the off-screen state to the on-screen state.
Those skilled in the art will appreciate that the architecture shown in fig. 15 is not limiting of the terminal 1500, and in many more possible implementations, the terminal 1500 includes more or fewer components than shown, or certain components may be combined, or a different arrangement of components may be employed.
In an exemplary embodiment, there is also provided a computer-readable storage medium, such as a memory including program code executable by a processor to perform the playback control method of multimedia data in the above-described embodiment. For example, the computer readable storage medium is Read-Only Memory (ROM), random-access Memory (Random Access Memory, RAM), compact disc Read-Only Memory (CD-ROM), magnetic tape, floppy disk, optical data storage device, and the like.
In an exemplary embodiment, there is also provided a computer program product including computer program code loaded and executed by a processor of a terminal to implement the play control method of multimedia data in the above-described embodiment.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments are implemented by hardware, or by a program stored in a computer readable storage medium, such as a rom, a magnetic disk or an optical disk, and the like, and the program code related hardware.
The foregoing description of the preferred embodiments is merely exemplary in nature and is not intended to limit the invention, but is intended to cover various modifications, substitutions, improvements, and alternatives falling within the spirit and principles of the invention.

Claims (9)

1. A play control method of multimedia data, the method comprising:
displaying a graphic generated based on a drawing operation in response to the drawing operation at a playback interface of target multimedia data;
determining a play control mode corresponding to the graph;
playing the target multimedia data based on the playing control mode;
the determining the playing control mode corresponding to the graph comprises the following steps:
under the condition that the graph is a double-speed graph, determining the playing control mode as double-speed playing;
determining the playing speed of the target multimedia data based on the number of edges of the double-speed graph;
wherein the multiple speed pattern comprises a polygon;
the displaying, in response to a drawing operation at a playback interface of the target multimedia data, a graphic generated based on the drawing operation, includes:
displaying operation guide information on a playing interface of the target multimedia data, wherein the operation guide information is used for guiding a user to draw a graph;
the determining the playing control mode corresponding to the graph further comprises:
determining the playing control mode as segmented playing under the condition that the graph is a plurality of segmented graphs;
Determining the length proportion of each segment graph under the condition that the segment graphs are not overlapped with each other;
dividing the target multimedia data into a plurality of multimedia fragments based on the length proportion of each segmented graph and the playing time length of the target multimedia data;
the segmented graphics comprise rectangles or line segments, and if the segmented graphics are rectangles, the length proportion is the length proportion corresponding to the long side of the rectangle; if the segmented graph is a line segment, the length proportion is the length proportion of each line segment.
2. The method according to claim 1, wherein playing the target multimedia data based on the play control manner includes:
playing any one of the plurality of multimedia fragments on the playing interface, wherein the playing interface comprises a switching control;
and responding to the triggering operation of the switching control, and playing the next multimedia fragment corresponding to any one multimedia fragment.
3. The method of claim 1, wherein determining the play control mode corresponding to the graphic further comprises:
determining the playing control mode as segmented playing under the condition that the graph is a plurality of segmented graphs;
Determining the length proportion of each segment graph under the condition that the segment graphs intersect;
dividing the target multimedia data into a plurality of multimedia fragments based on the length proportion of each segmented graph and the playing time length of the target multimedia data;
and determining the intersecting position of each segment graph as the target moment in each multimedia segment.
4. The method according to claim 3, wherein playing the target multimedia data based on the play control manner includes:
playing any one of the plurality of multimedia fragments on the playing interface, wherein the playing interface comprises a switching control;
and when the target time in any one of the multimedia fragments is played, responding to the triggering operation of the switching control, and starting to play the next multimedia fragment from the target time in the next multimedia fragment corresponding to the any one of the multimedia fragments.
5. The method of claim 1, wherein determining the play control mode corresponding to the graphic further comprises:
and determining the playing control mode as cyclic playing under the condition that the graph is a circular ring.
6. The method according to claim 1, wherein determining the play control mode corresponding to the graphic includes:
and in the case that the graph is an arrow and the arrow points to the left, determining the playing control mode as reverse playing.
7. A playback control apparatus for multimedia data, the apparatus comprising:
a display module for responding to the drawing operation of the playing interface of the target multimedia data and displaying the graph generated based on the drawing operation;
the determining module is used for determining a play control mode corresponding to the graph;
the playing module is used for playing the target multimedia data based on the playing control mode;
the determining module is used for determining the playing control mode as double-speed playing under the condition that the graph is double-speed graph; determining the playing speed of the target multimedia data based on the number of edges of the double-speed graph; wherein the multiple speed pattern comprises a polygon;
the display module is further used for displaying operation guide information on a playing interface of the target multimedia data, and the operation guide information is used for guiding a user to draw a graph;
The determining module is further configured to determine the play control mode as a segment play when the graphics are a plurality of segment graphics; determining the length proportion of each segment graph under the condition that the segment graphs are not overlapped with each other; dividing the target multimedia data into a plurality of multimedia fragments based on the length proportion of each segmented graph and the playing time length of the target multimedia data;
the segmented graphics comprise rectangles or line segments, and if the segmented graphics are rectangles, the length proportion is the length proportion corresponding to the long side of the rectangle; if the segmented graph is a line segment, the length proportion is the length proportion of each line segment.
8. A terminal comprising one or more processors and one or more memories, the one or more memories having stored therein at least one program code loaded and executed by the one or more processors to implement the operations performed by the play control method of multimedia data as claimed in any of claims 1 to 6.
9. A computer-readable storage medium, in which at least one program code is stored, the program code being loaded and executed by a processor to implement operations performed by a play control method of multimedia data as claimed in any one of claims 1 to 6.
CN202110838601.XA 2021-07-23 2021-07-23 Method, device, terminal and readable storage medium for controlling playing of multimedia data Active CN113507647B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110838601.XA CN113507647B (en) 2021-07-23 2021-07-23 Method, device, terminal and readable storage medium for controlling playing of multimedia data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110838601.XA CN113507647B (en) 2021-07-23 2021-07-23 Method, device, terminal and readable storage medium for controlling playing of multimedia data

Publications (2)

Publication Number Publication Date
CN113507647A CN113507647A (en) 2021-10-15
CN113507647B true CN113507647B (en) 2024-02-20

Family

ID=78013978

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110838601.XA Active CN113507647B (en) 2021-07-23 2021-07-23 Method, device, terminal and readable storage medium for controlling playing of multimedia data

Country Status (1)

Country Link
CN (1) CN113507647B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104156162A (en) * 2013-05-14 2014-11-19 腾讯科技(深圳)有限公司 Broadcast progress adjusting method, device and terminal
WO2017016339A1 (en) * 2015-07-27 2017-02-02 腾讯科技(深圳)有限公司 Video sharing method and device, and video playing method and device
CN107295416A (en) * 2017-05-05 2017-10-24 中广热点云科技有限公司 The method and apparatus for intercepting video segment
CN108650554A (en) * 2018-04-26 2018-10-12 维沃移动通信有限公司 A kind of multimedia file broadcasting control method and mobile terminal
CN110113645A (en) * 2019-05-09 2019-08-09 腾讯科技(深圳)有限公司 Control method for playing back, device, electronic equipment and the storage medium of multimedia equipment
CN111061412A (en) * 2019-10-31 2020-04-24 北京奇艺世纪科技有限公司 Playing control method and device for multimedia resources
CN111327951A (en) * 2020-03-24 2020-06-23 苏州科达科技股份有限公司 Multimedia data playing method, device, system and storage medium
CN112104915A (en) * 2020-09-14 2020-12-18 腾讯科技(深圳)有限公司 Video data processing method and device and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11023115B2 (en) * 2015-12-28 2021-06-01 The Directv Group, Inc. Circular video player controls
CN112104921A (en) * 2019-06-18 2020-12-18 上海哔哩哔哩科技有限公司 Video playing method and device and computer equipment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104156162A (en) * 2013-05-14 2014-11-19 腾讯科技(深圳)有限公司 Broadcast progress adjusting method, device and terminal
WO2017016339A1 (en) * 2015-07-27 2017-02-02 腾讯科技(深圳)有限公司 Video sharing method and device, and video playing method and device
CN107295416A (en) * 2017-05-05 2017-10-24 中广热点云科技有限公司 The method and apparatus for intercepting video segment
CN108650554A (en) * 2018-04-26 2018-10-12 维沃移动通信有限公司 A kind of multimedia file broadcasting control method and mobile terminal
CN110113645A (en) * 2019-05-09 2019-08-09 腾讯科技(深圳)有限公司 Control method for playing back, device, electronic equipment and the storage medium of multimedia equipment
CN111061412A (en) * 2019-10-31 2020-04-24 北京奇艺世纪科技有限公司 Playing control method and device for multimedia resources
CN111327951A (en) * 2020-03-24 2020-06-23 苏州科达科技股份有限公司 Multimedia data playing method, device, system and storage medium
CN112104915A (en) * 2020-09-14 2020-12-18 腾讯科技(深圳)有限公司 Video data processing method and device and storage medium

Also Published As

Publication number Publication date
CN113507647A (en) 2021-10-15

Similar Documents

Publication Publication Date Title
CN109874312B (en) Method and device for playing audio data
CN110602321B (en) Application program switching method and device, electronic device and storage medium
CN109327608B (en) Song sharing method, terminal, server and system
CN109922356B (en) Video recommendation method and device and computer-readable storage medium
CN112181572A (en) Interactive special effect display method and device, terminal and storage medium
CN109800003B (en) Application downloading method, device, terminal and storage medium
CN111459363A (en) Information display method, device, equipment and storage medium
WO2020244516A1 (en) Online interaction method and device
CN111083526B (en) Video transition method and device, computer equipment and storage medium
CN113032590B (en) Special effect display method, device, computer equipment and computer readable storage medium
CN112966130B (en) Multimedia resource display method, device, terminal and storage medium
CN112822544B (en) Video material file generation method, video synthesis method, device and medium
CN111158575B (en) Method, device and equipment for terminal to execute processing and storage medium
CN110868642B (en) Video playing method, device and storage medium
CN112616082A (en) Video preview method, device, terminal and storage medium
CN110152309B (en) Voice communication method, device, electronic equipment and storage medium
EP4125274A1 (en) Method and apparatus for playing videos
CN113301422B (en) Method, terminal and storage medium for acquiring video cover
CN111464829B (en) Method, device and equipment for switching media data and storage medium
CN113507647B (en) Method, device, terminal and readable storage medium for controlling playing of multimedia data
CN111314205B (en) Instant messaging matching method, device, system, equipment and storage medium
CN111369434B (en) Method, device, equipment and storage medium for generating spliced video covers
CN110519614B (en) Method, device and equipment for interaction between accounts in live broadcast room
CN110267114B (en) Video file playing method, device, terminal and storage medium
CN109189525B (en) Method, device and equipment for loading sub-page and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant