WO2023232066A1 - 多媒体片段的速度调整方法、装置、设备及介质 - Google Patents

多媒体片段的速度调整方法、装置、设备及介质 Download PDF

Info

Publication number
WO2023232066A1
WO2023232066A1 PCT/CN2023/097371 CN2023097371W WO2023232066A1 WO 2023232066 A1 WO2023232066 A1 WO 2023232066A1 CN 2023097371 W CN2023097371 W CN 2023097371W WO 2023232066 A1 WO2023232066 A1 WO 2023232066A1
Authority
WO
WIPO (PCT)
Prior art keywords
speed
control point
target interval
adjusted
interval
Prior art date
Application number
PCT/CN2023/097371
Other languages
English (en)
French (fr)
Inventor
边伟博
曾祥瑞
Original Assignee
北京字跳网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京字跳网络技术有限公司 filed Critical 北京字跳网络技术有限公司
Publication of WO2023232066A1 publication Critical patent/WO2023232066A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level

Definitions

  • the present disclosure relates to the field of video processing technology, and in particular, to a speed adjustment method, device, equipment and medium for multimedia clips.
  • the speed change adjustment methods include conventional uniform speed change and curve speed change.
  • the user selects the required template from the speed change templates preset in the application and applies it according to the needs.
  • Embodiments of the present disclosure provide a method for adjusting the speed of multimedia clips.
  • the method includes: dividing the multimedia material clips into multiple intervals on an audio and video editing track, where the multiple intervals include a target interval, and in the The multimedia material clip is provided with a first control point and a second control point corresponding to the target interval; in response to the movement operation of the first control point, according to the movement of the first control point on the editing track The position adjusts the speed change amount, controls the speed of the video frame in the target interval to change according to the adjusted speed change amount, and adjusts the display of the target interval on the editing track according to the playback duration after the speed change. Length; in response to the movement operation of the second control point, adjust the slope of the speed curve according to the position of the second control point on the target interval, and control the video frame speed in the target interval after adjustment according to the slope speed curve.
  • Embodiments of the present disclosure also provide a speed adjustment device for multimedia clips.
  • the device includes: a dividing module for dividing the multimedia material clips into multiple intervals on the audio and video editing track.
  • the multiple intervals include targets. interval, and a first control point and a second control point corresponding to the target interval are provided on the multimedia material clip; a first variable speed control module, configured to respond to the movement operation of the first control point, Adjust the speed change amount according to the position of the first control point on the editing track to control the video in the target interval
  • the speed of the frame changes according to the adjusted speed change, and according to the playback duration after the speed change, the display length of the target interval on the editing track is correspondingly adjusted;
  • the second speed change control module is used to respond to the The moving operation of the second control point adjusts the slope of the speed curve according to the position of the second control point on the target interval, and controls the video frame speed in the target interval to change speed according to the slope-adjusted speed curve.
  • An embodiment of the present disclosure also provides an electronic device.
  • the electronic device includes: a processor; a memory used to store instructions executable by the processor; and the processor is used to read the instruction from the memory.
  • the instructions can be executed and executed to implement the speed adjustment method for multimedia clips as provided by embodiments of the present disclosure.
  • Embodiments of the present disclosure also provide a computer-readable storage medium, the storage medium stores a computer program, and the computer program is used to execute the speed adjustment method of multimedia clips as provided by the embodiments of the present disclosure.
  • An embodiment of the present disclosure also provides a computer program, including: instructions, which when executed by a processor, cause the processor to execute the speed adjustment method for media segments provided by the embodiment of the present disclosure.
  • Figure 1 is a schematic flowchart of a speed adjustment method for multimedia clips provided by an embodiment of the present disclosure
  • Figure 2 is a schematic diagram of a speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure
  • Figure 3A is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure
  • Figure 3B is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 4A is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 4B is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 5A is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 5B is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 6A is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 6B is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 6C is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 7 is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 8A is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 8B is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 9A is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 9B is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 10A is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 10B is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 10C is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 11 is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 12A is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 12B is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 13A is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 13B is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 14 is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 15 is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 16 is a schematic diagram of another speed adjustment scenario for audio and video information provided by an embodiment of the present disclosure.
  • Figure 17 is a schematic structural diagram of a speed adjustment device for multimedia clips provided by an embodiment of the present disclosure.
  • Figure 18 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.
  • the term “include” and its variations are open-ended, ie, “including but not limited to.”
  • the term “based on” means “based at least in part on.”
  • the term “one embodiment” means “at least one embodiment”; the term “another embodiment” means “at least one additional embodiment”; and the term “some embodiments” means “at least some embodiments”. Relevant definitions of other terms will be given in the description below.
  • the method in which the user selects the required template from the preset speed change templates in the application and applies it according to the needs does not well meet the user's personalized speed adjustment needs.
  • the adjustment process of the custom speed change method is to adjust the speed curve by dragging several control points on the function panel.
  • adjusting one control point will cause the speed curve of the two areas of the control point to change accordingly, resulting in the speed adjustment of the audio and video clips.
  • the accuracy is very low and the efficiency is also very poor.
  • embodiments of the present disclosure provide a speed adjustment method for multimedia clips.
  • the multimedia material is divided into multiple intervals.
  • the video frame playback speeds between multiple intervals are adjusted independently and independently of each other, and the overall playback speed of the video frames in each interval can be adjusted based on the first control point.
  • the playback speed can also be adjusted based on the second control point, so that different video frames in the same interval have different playback speeds. As a result, fine adjustment of the video frame playback speed is achieved, and the accuracy and efficiency of the video frame playback speed adjustment are improved.
  • the present disclosure provides a speed adjustment method, device, equipment and medium for multimedia clips to achieve fine adjustment of the video frame playback speed and improve the video frame speed. Playback speed adjustment with precision and efficiency.
  • FIG. 1 is a schematic flowchart of a method for adjusting the speed of multimedia clips provided by an embodiment of the present disclosure.
  • the method may be performed by a speed adjustment device for a multimedia segment, wherein the device may be implemented using software and/or hardware, and may generally be integrated in an electronic device.
  • the method includes steps 101 to 103.
  • Step 101 Divide the multimedia material clip into multiple intervals on the audio and video editing track.
  • the plurality of intervals include a target interval, and a first control point and a second control point corresponding to the target interval are set on the multimedia material clip.
  • the audio and video editing track is mapped to the video stream to be adjusted, and different intervals on the track correspond to different video stream segments in the pre-video stream.
  • the display of audio and video editing tracks can be pulled up through some shortcut keys, or by triggering preset controls, etc., which are not listed here.
  • the multimedia material in order to achieve fine adjustment of the video frame playback speed in the video stream, the multimedia material is divided into different intervals in the audio and video editing track.
  • the initial playback speed of the corresponding video frame in the interval can be the playback speed of the video stream before segmentation.
  • a preset video threshold can be calibrated based on experimental data, for example, it can be 3 and so on. If it is detected that the number of video frames is less than the video threshold, a prompt message that cannot be divided is displayed. For example, a pop-up window displays a message such as "The interval is too small and cannot be added.”
  • dividing points may be used as distinguishing marks of different intervals.
  • the dividing point can be any identifier indicating that the video stream is divided into different intervals, including but not limited to one or more of text identifiers, letter identifiers, pattern identifiers, color identifiers, etc.
  • the dividing points are two opposite trapezoidal patterns, and the corresponding video stream is divided into multiple intervals by the dividing points.
  • the intervals Q1 and Q2 include dividing point 1 in the middle, and dividing point 1 includes two corresponding trapezoidal patterns a1 and a2.
  • a partial area of the dividing point is used as the first control point of the adjacent target interval.
  • the first control point is used to divide the speed adjustment of the target section from the speed adjustment of other sections.
  • the first adsorption control switch in response to the opening operation of the first adsorption control switch on the target interval (
  • the first adsorption control switch can be a control displayed on the visual interface, etc.), obtains the end position of the first control point's movement operation on the editing track, and adsorbs the end position to the split positions of other adjacent intervals. That is to say, it is guaranteed to follow the movement of the first control point, and other dividing points and intervals on the audio and video editing track will follow the movement as a whole.
  • the first control point is used alone to control the playback speed of the video frames in the corresponding target interval.
  • Different intervals correspond to different first control points, which can achieve independent control of the playback speed of the video frames in different intervals. Adjustment.
  • the setting positions of the first control points in adjacent target intervals are different.
  • the first control point is set at the end of the target interval.
  • the dividing point usually defines the interval located in the middle of the left and right area parts through the left and right area parts. Therefore, the left half area of the dividing point, that is, the dividing point area corresponding to the end position of the target interval, can be used as the first control point of the target interval adjacent to the left, as shown in Figure 3A; if the dividing point is as above As shown in Figure 2, for the dividing point 1, the trapezoidal pattern a1 located in the left half of the area can be used as the first control point. This first control point is used to control the left section Q1 adjacent to the trapezoidal pattern a1. Video frame playback speed.
  • the first control point is set at the starting position of the target interval.
  • the dividing point usually defines the interval located in the middle of the left and right area parts through the left and right area parts. Therefore, the left half area of the segmentation point, that is, the segmentation point area corresponding to the starting position of the target interval, can be used as the first control point of the target interval adjacent to the left, as shown in Figure 3B; if the segmentation point is as follows As shown in Figure 2 above, for the dividing point 1, the trapezoidal pattern a2 located in the right half of the area can be used as the first control point. This first control point is used to control the section Q2 adjacent to the right side of the trapezoidal pattern a2. video frame playback speed.
  • a second control point is also provided on the multimedia material clip.
  • the second control point is used to adjust the playback speed of the video frame in the target interval.
  • Step 102 In response to the movement operation of the first control point, adjust the speed change amount according to the position of the first control point on the editing track, control the speed of the video frame in the target interval to change according to the adjusted speed change amount, and adjust the speed according to the adjusted speed change amount.
  • the playback duration after the speed changes corresponds to the display length of the telescopic adjustment target interval on the editing track.
  • the first control point is used to adjust the playback speed of the video frame in the target interval. Therefore, in response to the movement operation of the first control point, the playback speed of the video frame in the target interval can be controlled.
  • the movement operation of the first control point may be triggered by the user's dragging, voice triggering, etc., which are not listed here.
  • the first control point in response to the movement operation of the first control point, the first control point is controlled to move on the editing track; the speed change is adjusted according to the position of the first control point on the editing track, and the target interval correlation is controlled.
  • the speed of the video frame is transformed according to the adjusted speed change.
  • the overall change in the playback speed of the video frames included in the target interval is controlled based on the first control point, and the degree of change in the overall speed depends on the length of movement of the first control point on the editing track, etc.
  • the playback duration after the speed change can be
  • the display length of the target interval on the editing track should be flexibly adjusted. For example, in order to further improve the intuitiveness of the adjustment, you can also visually enhance the display of the target interval being adjusted. For example, use a rectangular frame to frame the area of the current target interval on the audio and video editing track, and highlight the rectangular frame, etc.
  • the speed change amount is adjusted in different ways according to the position of the first control point on the editing track. Examples are as follows.
  • the end position of the target interval is used as the first control point of the target interval adjacent to the left, then in response to the rightward movement operation of the first control point, the end point of the target interval is controlled to be on the editing track is stretched to the right; the speed change is reduced based on the position of the first control point on the editing track.
  • the starting point of the target interval remains in the same position on the editing track.
  • the video frame corresponding to each target interval is unchanged.
  • the first control point is adjusted to change the position of the end point of the target interval on the editing track, so that the end point of the target interval is on the editing track. Stretching the position on to the right can be equivalent to extending the playback duration of the video frame corresponding to the target interval. Therefore, it is equivalent to reducing the playback speed of the video frames in the target interval, and reducing the speed change amount according to the position of the first control point on the editing track to reduce the playback speed of the video frames in the target interval.
  • the position of the end point of the target interval on the editing track is stretched to the right; according to the first control
  • the point's position on the edit track decreases the speed delta. For example, if the position of the end point of the target interval on the editing track is stretched by L1 to the right, the speed change is reduced by 0.5X. Therefore, the video frame playback speed in the target interval is reduced from the original 1X to 0.5X.
  • the position of the control target interval end point on the editing track is shortened to the left; the speed change is increased according to the position of the first control point on the editing track.
  • the position of the starting point of the target interval on the editing track remains unchanged.
  • the video frame corresponding to each target interval is unchanged.
  • the first control point is adjusted to change the position of the end point of the target interval on the editing track, so that the end point of the target interval is on the editing track.
  • Shortening the position on to the left can be equivalent to shortening the playback duration of the video frame corresponding to the target interval. Therefore, it is equivalent to increasing the playback speed of the video frames in the target interval, and increasing the speed change amount according to the position of the first control point on the editing track to increase the playback speed of the video frames in the target interval.
  • the position of the end point of the control target interval on the editing track is shortened to the left; according to the first control point Increases the speed delta at the position on the edit track.
  • the position of the target interval end point on the editing track is shortened to the left. If L2 is removed, the speed change increases by 0.25X. Therefore, the video frame playback speed within the target interval is increased from the original 1X to 1.25X.
  • the starting position of the target interval is used as the first control point of the target interval adjacent to the right, then in response to the rightward movement operation of the first control point, the starting point of the target interval is controlled to be on the editing track
  • the position on is shortened to the right; the speed change is increased according to the position of the first control point on the editing track, and the position of the target interval end point on the editing track remains unchanged.
  • the video frame corresponding to each target interval is unchanged.
  • the first control point is adjusted to change the position of the starting point of the target interval on the editing track, and the starting point of the target interval is placed on the editing track.
  • Shortening the position on to the right can be equivalent to shortening the playback duration of the video frame corresponding to the target interval. Therefore, it is equivalent to increasing the playback speed of the video frames in the target interval, and increasing the speed change amount according to the position of the first control point on the editing track to increase the playback speed of the video frames in the target interval.
  • the position of the starting point of the control target interval on the editing track is shortened to the right; according to the first control point Increases the speed delta at the position on the edit track. For example, if the position of the starting point of the target interval on the editing track is shortened by L3 to the right, the speed change increases by 0.25X. Therefore, the video frame playback speed in the target interval is increased from the original 1X to 1.25X.
  • the position of the starting point of the control target interval on the editing track is stretched to the left, and the position of the first control point on the editing track is reduced.
  • the amount of speed change and the end point of the target interval remain unchanged on the editing track.
  • the video frame corresponding to each target interval is unchanged.
  • the first control point is adjusted to change the position of the starting point of the target interval on the editing track, and the starting point of the target interval is placed on the editing track. Stretching the position on to the left can be equivalent to increasing the playback duration of the video frame corresponding to the target interval. Therefore, it is equivalent to reducing the playback speed of the video frames in the target interval, and reducing the speed change amount according to the position of the first control point on the editing track to reduce the playback speed of the video frames in the target interval.
  • the position of the starting point of the target interval on the editing track is stretched to the left, according to the first control point
  • the point's position on the edit track decreases the speed delta. For example, if the starting point of the target interval on the editing track is stretched by L4 to the left, the speed change is reduced by 0.25X. Therefore, the video frame playback speed in the target interval is reduced from the original 1X to 0.75X.
  • Step 103 in response to the movement operation of the second control point on the target interval, based on the second control point on the target interval
  • the position on the interval adjusts the slope of the speed curve, and the speed of the video frame in the target interval is controlled to change according to the slope-adjusted speed curve.
  • the first control point is only used to control the overall playback speed of the video frames in the target interval, for example, as shown in Figure 6A, if the target interval contains 10 video frames, and the playback speeds of the 10 video frames are all the same.
  • the effect that can be achieved based on the first control point is to control the overall increase or overall shortening of the playback speed of 10 video frames.
  • the playback speed of each video frame is the same (the display width of the video frame in the figure reflects the playback speed of the video frame).
  • the above-mentioned method of adjusting the playback speed based only on the first control point shows that the degree of refinement is not high. For example, as shown in Figure 6B, if the target interval contains 10 video frames, the user hopes that the playback speed of these 10 video frames will gradually decrease or gradually increase (the display width of the video frame in the figure reflects the playback speed of the video frame ).
  • a second control point for the target interval is also set.
  • the visual display of the second control point includes, but is not limited to, one or more of text logos, letter logos, pattern logos, color logos, etc.
  • the slope of the speed curve is adjusted according to the position of the second control point on the target interval, and the speed of the video frame in the target interval is controlled to change according to the slope-adjusted speed curve.
  • the vertical axis of the speed curve corresponds to the playback speed
  • the horizontal axis corresponds to the video frame in the target interval. Therefore, the slope of the speed curve can determine the playback speed of the video frame in the target interval, and can be refined to the video frame to realize variable speed adjustment of the playback speed. For example, referring to FIG. 7 , the steeper the speed curve is, the greater the change rate of the corresponding playback speed is; conversely, the flatter the speed curve is, the lower the change rate of the corresponding playback speed is.
  • the slope of the speed curve is adjusted in different ways according to the position of the second control point on the target interval. Please refer to subsequent embodiments for the different adjustment methods, which will not be described again here.
  • the first control point is mainly used to control the overall playback speed of the video frame in the corresponding target interval. Therefore, as shown in FIG. 6A above, if the video frames in the target interval are played at a constant speed, the speed of the video frames in the target interval is controlled to be faster or slower according to the adjusted speed change amount to play at a constant speed.
  • the effect achieved based on the first control point is also an overall change based on the speed change. That is, when the video frames in the target interval are played at a non-uniform speed according to the speed curve, the speed of the video frames in the target interval is controlled to be adjusted according to The subsequent speed change becomes faster or slower for non-uniform speed playback.
  • the playback speed of these 10 video frames determined based on the speed curve gradually decreases. If the corresponding speed change determined based on the movement operation of the first control point is a speed reduction of 0.5X, then while maintaining the gradual reduction in the playback speed of these 10 video frames, the overall playback speed is reduced according to the 0.5X.
  • the speed adjustment method of multimedia clips divides the multimedia material clips into multiple intervals on the audio and video editing track.
  • the plurality of sections include a target section, and a first control point and a second control point corresponding to the target section are set on the multimedia material clip.
  • the speed change amount is adjusted according to the position of the first control point on the editing track, and the speed of the video frame in the target interval is controlled to change according to the adjusted speed change amount; and according to the speed change,
  • the playback duration corresponds to the telescopic adjustment of the display length of the target interval on the editing track; in response to the movement operation of the second control point on the target interval, the slope of the speed curve is adjusted according to the position of the second control point on the target interval to control the target interval
  • the speed of the inner video frame changes according to the slope-adjusted speed curve.
  • the video frame playback speeds between the multiple intervals are adjusted independently and independently of each other, and the overall playback speed of the video frames in each interval can be realized based on the first control point. Adjustment.
  • the playback speed can also be adjusted based on the second control point, so that different video frames in the same interval have different playback speeds. As a result, fine adjustment of the video frame playback speed is achieved, and the accuracy and efficiency of the video frame playback speed adjustment are improved.
  • schematic diagrams corresponding to multimedia material clips can also be displayed in the function panel area.
  • the schematic diagram includes a speed control mark corresponding to and corresponding to the first control point, and displays the speed adjusted to the target section according to the first control point in the area corresponding to the schematic section. Therefore, based on the linked display of the schematic diagram and the audio and video editing track, the speed adjustment of the current first control point can be intuitively displayed.
  • FIG. 8A a schematic diagram of associated display and multimedia material clips in the function panel area is shown.
  • the schematic diagram includes a speed control mark corresponding to the first control point and a schematic interval Qs' corresponding to the target interval Qs.
  • the first control point a2s is used as the speed control mark of the adjacent schematic interval, and the speed adjusted to the target interval according to the first control point is displayed in the corresponding area of the schematic interval Qs'.
  • the adjusted speed in the figure is 0.5X.
  • the speed adjusted according to the second control point is also displayed in conjunction with the schematic diagram, that is, the slope of the speed curve is adjusted according to the position of the second control point in the target interval; and the slope is displayed in association with the schematic interval.
  • the adjusted speed curve and the speed interval value of the speed curve are also displayed in conjunction with the schematic diagram.
  • the position of the second control point in the target interval Qs moves from the center position to At the end position of the target section, the slope of the speed curve is adjusted according to the position of the second control point in the target section.
  • the resulting speed curve S1 and speed section value are as shown in the figure. Users can intuitively see the speed adjustment results.
  • the speeds corresponding to the speed control identifiers of adjacent schematic intervals are compared.
  • the speed corresponding to the speed control logo at the end position of the left section is the same as the speed corresponding to the speed control logo at the start position of the right section, as shown in Figure 9A
  • the two speed control logos are merged and stored for display on the mobile device.
  • a speed control point when the speed corresponding to the speed control mark at the end of the left section is different from the speed corresponding to the speed control mark at the start of the right section, as shown in Figure 9B, the two speed control marks can be stored separately Two speed control points for display on mobile devices.
  • the schematic diagram in order to further facilitate user adjustment, can be stored as a draft and can be synchronized and displayed on other devices. For example, synchronize the schematic diagram adjusted on the PC to the mobile device for display, etc.
  • the user can operate the schematic diagram on the mobile terminal; if the first control point is identified by a partial area of the dividing point, in this embodiment , for a dividing point containing two areas, it can be displayed in other patterns on the mobile terminal. That is, conversion and display are performed on the mobile terminal to adapt to the display rules of the mobile terminal.
  • areas with different dividing points are displayed in the form of dots. If it is detected that the user drags one of the dots, the x-axis coordinate of the point can be changed, and the two points are separated by m pixels; if synchronized to the PC segment, the corresponding two dots are displayed as different areas of the dividing point.
  • the interval between different areas of the PC-side segmentation point is 1 frame, the minimum number of video frames included in the interval is also limited. For example, it cannot be less than 3 frames. If the x-axis corresponding to the dot dragged on the mobile side conflicts with the display rules on the PC side, the dot can be discarded after the interaction and the dividing point corresponding to the dot will not be displayed on the PC side. area etc.
  • the two points on the mobile terminal are merged and displayed as a complete dividing point, and the extra The dots are not merged.
  • the intervals between the three points abc are 1 frame, ab is combined and displayed as a complete dividing point, and c is independently displayed as a partial area of a dividing point.
  • the x-axis distance is not equal to 1 frame, a dot is displayed as a partial area of the dividing point. .
  • the first dividing point area in the interval where the video frames are less than the preset minimum number of video frames can be retained and the Delete other segmentation point areas, etc.
  • a schematic diagram corresponding to the multimedia material clips is displayed in association with the function panel area.
  • the schematic diagram includes a schematic interval corresponding to the target interval, and the schematic diagram
  • the area corresponding to the middle indicated interval displays the speed adjustment results of the first control point and the second control point on the target interval, which improves the intuitiveness of speed adjustment and improves the user experience of speed adjustment.
  • the triggering operation of the above-mentioned second control point is used to control the variable speed change of the video frame in the target interval.
  • the second control point determines the slope of the speed curve of the variable speed change. The following is how to control the speed change of the video frame in the target interval according to the second control point.
  • the slope of the position adjustment speed curve is illustrated as an example.
  • adjusting the slope of the speed curve according to the position of the second control point on the target interval includes the following steps.
  • the slope of the speed curve is adjusted according to the added position of the second control point on the target interval.
  • the second control point is set at different positions between the target areas, the corresponding slopes will be different. For example, in response to the second control point being located in the middle of the target interval, adjusting the slope of the speed curve to zero generates a uniform straight line that matches the speed adjusted by the first control point, thereby controlling the speed of the video frames in the target interval according to the uniform speed. Play in a straight line.
  • the position of the dot set in the target interval determines the slope of the speed curve; if it is a "dot” setting At the middle position of the track corresponding to the target interval, the corresponding slope is 0. At this time, the video frames in the target interval are played at a constant speed.
  • the corresponding slope will change accordingly. For example, the average slope of the speed curve gradually increases.
  • the playback speed of the video frame in the target interval changes with the change of the slope. Changes realize the adjustment of the playback speed; if the "dot" moves to the left position of the track corresponding to the target interval, it will follow the corresponding slope change. For example, the average slope of the speed curve gradually decreases. At this time, the The video frame playback speed changes with the change of the slope, realizing the adjustment of the playback speed.
  • the slope of the speed curve in response to the movement operation of the second control point, can be adjusted according to the movement position of the second control point on the target interval, and in response to the addition of the second control point on the target interval.
  • the slope of the speed curve after adjusting the slope of the speed curve according to the added position of the second control point on the target interval, can be adjusted according to the moving position of the second control point on the target interval. For example, if the second control point is in the target interval The slope corresponding to the added position on is 0, and with the rightward or leftward movement of the second control point, the slope of the speed curve can be adjusted.
  • candidate position points of the movement of the second control point on the target interval are obtained, and a corresponding relationship between each candidate position point and the slope is constructed.
  • the change in slope between different candidate position points can be compared with the change of the candidate position point.
  • Position changes may or may not be associated, and there is no restriction here.
  • the target position point to which the second control point moves is determined, and the above corresponding relationship is queried to determine the slope corresponding to the target position point to adjust the slope of the speed curve.
  • the slope of the speed curve in response to the second control point moving between the middle position and the end position of the target interval, is adjusted to generate an ascending speed curve.
  • the speed curve corresponds to The slope value is the largest, that is, when the second control point is at the end of the target interval, the overall rising speed curve is steeper.
  • the maximum slope value at this time can be understood as the maximum average slope value of the speed curve.
  • the slope change rate from the starting position to the center position of the target interval is the largest, thereby controlling the target interval.
  • the playback speed of the video frames within is played according to the rising speed curve.
  • the second control point will be The movement is associated with the increase of the slope, which enhances the interactive feeling of the operation.
  • the rising speed curve can It can be in any form.
  • the slope can be the center point as the symmetry center. The slope gradually increases from the starting position to the center position of the target interval, and the slope gradually decreases from the center position to the end position of the target interval. Wait, in this embodiment, continue to refer to Figure 12A. As the second control point approaches the end position of the target interval, the change rate of the slope from the starting position to the center position of the target interval gradually increases.
  • the second control point The point is located at the end of the target interval, and the slope change rate from the starting position to the center position of the target interval is the largest. At this time, the corresponding slope value of the speed curve is the largest, and the overall speed curve is the steepest.
  • the slope can be a sine wave curve with a positive slope. From the starting position of the target interval to the end position, the slope of the speed curve gradually decreases. Continuing to refer to Figure 12B, along with the second control point As it approaches the end position of the target interval, the change rate of the slope from the starting position to the center position of the target interval gradually increases. If the second control point is located at the end position of the target interval, the slope value of the speed curve is the largest.
  • the slope of the speed curve in response to the second control point moving between the intermediate position and the starting position of the target interval, is adjusted to generate a descending speed curve.
  • the slope value corresponding to the speed curve is the smallest, and then the playback speed of the video frames in the target interval is controlled to be played according to the descending speed curve.
  • the slope of the descending speed curve is a negative value, when the slope value corresponding to the speed curve is the smallest, the steeper the speed curve is.
  • the minimum slope value can be understood as each point included in the speed curve. The mean of the slope values is the smallest and so on.
  • the movement of the two control points is associated with the increase of the slope, which enhances the interactive feeling of the operation.
  • the descending speed curve It can be in any form.
  • the slope can have the center point as the center of symmetry.
  • the absolute value of the slope from the starting position to the center position of the target interval gradually increases, and from the center position to the end position of the target interval, the absolute value of the slope gradually increases.
  • the absolute value of the slope gradually decreases, etc.
  • the absolute value of the slope from the starting position of the target interval to the center position The rate of change gradually increases. If the second control point is located at the starting position of the target interval, the negative speed curve has the smallest slope value and the steepest speed curve.
  • the slope can be a sine wave curve with a negative slope. From the starting position of the target interval to the end position, the absolute value of the slope of the speed curve gradually increases. With continued reference to Figure 13B, along with The degree to which the second control point is close to the starting position of the target interval, the change rate of the slope from the starting position to the center position of the target interval gradually increases. If the second control point is located at the starting position of the target interval, it will be a negative speed curve. The slope value is the smallest and the speed curve is the steepest.
  • the speed interval value of the speed curve is also limited, based on The speed interval value defines the speed adjustment range.
  • the speed interval value of the adjusted speed curve is determined based on the speed adjusted by the first control point and the preset speed range corresponding to the slope of the adjusted speed curve, and the speed interval value is displayed on the first
  • the second control point is in the preset area of the target interval position, and the display mode can be any form such as label display, floating display, etc., used to indicate the adjustment speed range corresponding to the current second control point.
  • the speed interval value of the adjusted speed curve can be determined based on the closeness of the speed adjusted by the first control point to the boundary value in the multiple speed range corresponding to the slope of the speed curve.
  • the first control point is The adjusted speed is used as the center position, and the close boundary value is used as a boundary of the speed interval, etc.
  • the speed adjusted by the first control point is 0.5X
  • the default speed range If the range is 0.1X-10X, then calculate the first multiple of 1X and 0.5X, and the second multiple of 10X and 0.5X respectively. Based on the first multiple and the second multiple, determine the smaller multiple, that is, the boundary corresponding to the first multiple. The value is 0.1X. Therefore, with 0.1X as the boundary value and 0.5X as the center value, the speed interval value of the speed curve is determined to be 0.1X-1X.
  • the summation value between the speed and the preset adjustment value is calculated, and the summation value between the first control point and the preset adjustment value is calculated.
  • Difference use the summation value and the difference value as the maximum interval boundary value and the minimum interval boundary value of the speed interval value respectively to determine the speed interval value of the adjusted speed curve.
  • the minimum value of the multiple speed range will be used as the minimum interval boundary value of the speed interval value.
  • the maximum value of the multiple speed range is used as the maximum interval boundary value of the speed interval value
  • the corresponding adjustment effect is also displayed in real time based on the video frame.
  • the speed adjustment state of the video frame with speed adjustment in the target interval is displayed, and the target interval is changed according to the slope-adjusted speed curve.
  • the video frames that become slower within the target range are widened and displayed, and the video frames that become faster within the target range are narrowed and displayed.
  • the width of the video frame reflects the speed adjustment of the corresponding video frame.
  • the video frame playback speed is 0.5X at a uniform speed, and the width of each video frame is the same; if the user drags the second control point
  • the video frames that become slower in the target interval are widened and displayed, and the video frames that become faster in the target interval are narrowed and displayed.
  • the speeds of junctions in different intervals are close to each other, the speeds can be aligned.
  • the second adsorption control switch in response to the second adsorption control opening operation, may be a visual control, etc., and the slope-adjusted speed curve is obtained according to the position of the second control point on the target interval.
  • the slope-adjusted speed curve determines the playback speed at the end of the target interval. If the difference between the playback speed at the end of the target interval and the playback speed at the start of the adjacent interval is less than the preset threshold, which is calibrated based on experimental data, then The end position of the target interval is aligned with the speed adjustment of the start position of the adjacent interval. This ensures the smoothness of video playback on the basis of meeting the user's personalized needs for playback speed.
  • the target interval end position is aligned with the speed adjustment of the adjacent interval start position.
  • the speed adjustment method of multimedia clips can flexibly determine the slope of the speed curve according to the movement operation of the second control point according to different application scenarios, thereby satisfying the variable speed adjustment of the playback speed of video frames in the target interval. demand, improving the flexibility of adjustment.
  • the present disclosure also provides a speed adjustment device for multimedia clips.
  • Figure 17 is a schematic structural diagram of a speed adjustment device for multimedia clips provided by an embodiment of the present disclosure.
  • the device can be implemented by software and/or hardware, and can generally be integrated in electronic equipment to adjust the speed of audio and video information.
  • the device includes: a dividing module 1710, a first transmission control module 1720 and a second transmission control module 1730.
  • the dividing module 1710 is used to divide the multimedia material clip into multiple intervals on the audio and video editing track.
  • the multiple intervals include target intervals, and a first control point and a second control point corresponding to the target interval are set on the multimedia material clip. point.
  • the first speed control module 1720 is configured to respond to the movement operation of the first control point, adjust the speed change amount according to the position of the first control point on the editing track, and control the speed of the video frame in the target interval according to the adjusted Change the speed according to the speed change amount, and adjust the display length of the target interval on the editing track according to the playback duration after the speed change.
  • the second variable speed control module 1730 is configured to respond to the movement operation of the second control point, adjust the slope of the speed curve according to the position of the second control point on the target interval, and control the video frame speed in the target interval according to the slope adjusted The speed curve changes speed.
  • the multimedia clip speed adjustment device provided by the embodiments of the present disclosure can execute the speed adjustment method of the multimedia clips provided by any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution method.
  • the present disclosure also proposes a computer program product, which includes a computer program/instructions.
  • a computer program product which includes a computer program/instructions.
  • the speed adjustment method for multimedia clips in the above embodiments is implemented.
  • Figure 18 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.
  • the electronic device 1800 in the embodiment of the present disclosure may include, but is not limited to, mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals ( Mobile terminals such as car navigation terminals) and digital TV, radio stations, etc. Fixed terminals for computers, etc.
  • the electronic device shown in FIG. 18 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.
  • electronic device 1800 may include a processor (eg, central processing unit, graphics processor, etc.) 1801 that may be loaded into random access memory according to a program stored in read-only memory (ROM) 1802 or from memory 1808 (RAM) 1803 to perform various appropriate actions and processes.
  • ROM read-only memory
  • RAM memory 1808
  • various programs and data required for the operation of the electronic device 1800 are also stored.
  • the processor 1801, ROM 1802 and RAM 1803 are connected to each other through a bus 1804.
  • An input/output (I/O) interface 1805 is also connected to bus 1804.
  • the following devices may be connected to the I/O interface 1805: input devices 1806 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, vibration An output device 1807 such as a computer; a memory 1808 including a magnetic tape, a hard disk, etc.; and a communication device 1809. Communication device 1809 may allow electronic device 1800 to communicate wirelessly or wiredly with other devices to exchange data.
  • FIG. 18 illustrates electronic device 1800 with various means, it should be understood that implementation or availability of all illustrated means is not required. More or fewer means may alternatively be implemented or provided.
  • embodiments of the present disclosure include a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart.
  • the computer program may be downloaded and installed from the network via communication device 1809, or from memory 1808, or from ROM 1802.
  • the processor 1801 When the computer program is executed by the processor 1801, the above-mentioned functions defined in the speed adjustment method of the multimedia clip according to the embodiment of the present disclosure are performed.
  • the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two.
  • the computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof.
  • Examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), erasable programmable read only memory Memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above.
  • a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device .
  • Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.
  • the client and server can communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium.
  • Communications e.g., communications network
  • communications networks include local area networks (“LAN”), wide area networks (“WAN”), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or developed in the future network of.
  • the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device.
  • the above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device causes the electronic device to operate.
  • the plurality of intervals include a target interval, and set a first control point and a second control point corresponding to the target interval on the multimedia material clip, in response to the The moving operation of a control point adjusts the speed change amount according to the position of the first control point on the editing track, controls the speed of the video frame in the target interval to change according to the adjusted speed change amount, and corresponds to the playback duration after the speed change.
  • Telescopically adjust the display length of the target interval on the editing track in response to the movement operation of the second control point on the target interval, adjust the slope of the speed curve according to the position of the second control point on the target interval, and control the length of the video frame in the target interval.
  • the speed changes according to the slope-adjusted speed curve. Therefore, by dividing the multimedia material into multiple intervals, the video frame playback speeds between the multiple intervals are adjusted independently and independently of each other, and the overall playback speed of the video frames in each interval can be realized based on the first control point. Adjustment can also be based on the second control point to realize variable speed adjustment of the playback speed, so that different video frames in the same interval have different playback speeds, thus achieving fine adjustment of the video frame playback speed and improving the video frame speed. Playback speed adjustment with precision and efficiency.
  • the electronic device may have computer program code for performing operations of the present disclosure written in one or more programming languages, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, or a combination thereof.
  • the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as an Internet service provider through Internet connection).
  • LAN local area network
  • WAN wide area network
  • An embodiment of the present disclosure also provides a computer program, including instructions that, when executed by a processor, cause the processor to perform the speed adjustment method of a media segment provided by an embodiment of the present disclosure.
  • each block in the flowchart or block diagram may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions.
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved.
  • each block of the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration can be implemented by special purpose hardware-based systems that perform the specified functions or operations. , or can be implemented using a combination of specialized hardware and computer instructions.
  • the units involved in the embodiments of the present disclosure can be implemented in software or hardware.
  • the name of a unit does not constitute a limitation on the unit itself.
  • FPGAs Field Programmable Gate Arrays
  • ASICs Application Specific Integrated Circuits
  • ASSPs Application Specific Standard Products
  • SOCs Systems on Chips
  • CPLD Complex Programmable Logical device
  • a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.
  • the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any suitable combination of the foregoing.
  • machine-readable storage media examples include one or more wire-based electrical connections, laptop disks, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • RAM random access memory
  • ROM read only memory
  • EPROM erasable programmable read only memory
  • flash memory flash memory
  • optical fiber portable compact disk read-only memory
  • CD-ROM compact disk read-only memory
  • magnetic storage device magnetic storage device

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

本公开实施例涉及一种多媒体片段的速度调整方法、装置、设备及介质，其中该方法包括：在音视频编辑轨道上将多媒体素材片段分割成多个区间；响应于对第一控制点的移动操作，根据第一控制点在编辑轨道上的位置调整速度变化量，控制目标区间内的视频帧速度按照调整后的速度变化量进行变速；并根据速度变化后的播放时长对应伸缩调整目标区间在编辑轨道上的显示长度；响应于对第二控制点的移动操作，根据第二控制点在目标区间上的位置调整速度曲线的斜率，控制目标区间内的视频帧速度按照斜率调整后的速度曲线进行变速。

Description

多媒体片段的速度调整方法、装置、设备及介质
相关申请的交叉引用
本申请是以CN申请号为202210622737.1，申请日为2022年6月1日的申请为基础，并主张其优先权，该CN申请的公开内容在此作为整体引入本申请中。
技术领域
本公开涉及视频处理技术领域，尤其涉及一种多媒体片段的速度调整方法、装置、设备及介质。
背景技术
随着音视频的普及流行，用户经常根据自己的需求对音视频片段进行变速调整。
在相关技术中，变速调整方式有常规的均匀变速和曲线变速，用户根据需求从应用中预设的变速模板中选择需要的模板进行套用。
发明内容
本公开实施例提供了一种多媒体片段的速度调整方法，所述方法包括：在音视频的编辑轨道上将多媒体素材片段分割成多个区间，所述多个区间包括目标区间，以及在所述多媒体素材片段上设置有与所述目标区间对应的第一控制点和第二控制点；响应于对所述第一控制点的移动操作，根据所述第一控制点在所述编辑轨道上的位置调整速度变化量，控制所述目标区间内视频帧的速度按照调整后的速度变化量进行变速，并根据速度变化后的播放时长，对应伸缩调整所述目标区间在所述编辑轨道上的显示长度；响应于对所述第二控制点的移动操作，根据所述第二控制点在所述目标区间上的位置调整速度曲线的斜率，控制所述目标区间内的视频帧速度按照斜率调整后的速度曲线进行变速。
本公开实施例还提供了一种多媒体片段的速度调整装置，所述装置包括：划分模块，用于在音视频的编辑轨道上将多媒体素材片段分割成多个区间，所述多个区间包括目标区间，以及在所述多媒体素材片段上设置有与所述目标区间对应的第一控制点和第二控制点；第一变速控制模块，用于响应于对所述第一控制点的移动操作，根据所述第一控制点在所述编辑轨道上的位置调整速度变化量，控制所述目标区间内视频 帧的速度按照调整后的速度变化量进行变速，并根据速度变化后的播放时长，对应伸缩调整所述目标区间在所述编辑轨道上的显示长度；第二变速控制模块，用于响应于对所述第二控制点的移动操作，根据所述第二控制点在所述目标区间上的位置调整速度曲线的斜率，控制所述目标区间内的视频帧速度按照斜率调整后的速度曲线进行变速。
本公开实施例还提供了一种电子设备，所述电子设备包括：处理器；用于存储所述处理器可执行指令的存储器；所述处理器，用于从所述存储器中读取所述可执行指令，并执行所述指令以实现如本公开实施例提供的多媒体片段的速度调整方法。
本公开实施例还提供了一种计算机可读存储介质，所述存储介质存储有计算机程序，所述计算机程序用于执行如本公开实施例提供的多媒体片段的速度调整方法。
本公开实施例还提供了一种计算机程序，包括：指令，所述指令当由处理器执行时使所述处理器执行本公开实施例提供的媒体片段的速度调整方法。
附图说明
结合附图并参考以下具体实施方式，本公开各实施例的上述和其他特征、优点及方面将变得更加明显。贯穿附图中，相同或相似的附图标记表示相同或相似的元素。应当理解附图是示意性的，原件和元素不一定按照比例绘制。
图1为本公开实施例提供的一种多媒体片段的速度调整方法的流程示意图；
图2为本公开实施例提供的一种音视频信息的速度调整场景示意图；
图3A为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图3B为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图4A为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图4B为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图5A为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图5B为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图6A为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图6B为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图6C为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图7为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图8A为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图8B为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图9A为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图9B为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图10A为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图10B为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图10C为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图11为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图12A为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图12B为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图13A为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图13B为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图14为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图15为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图16为本公开实施例提供的另一种音视频信息的速度调整场景示意图；
图17为本公开实施例提供的一种多媒体片段的速度调整装置的结构示意图；
图18为本公开实施例提供的一种电子设备的结构示意图。
具体实施方式
下面将参照附图更详细地描述本公开的实施例。虽然附图中显示了本公开的某些实施例，然而应当理解的是，本公开可以通过各种形式来实现，而且不应该被解释为限于这里阐述的实施例，相反提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是，本公开的附图及实施例仅用于示例性作用，并非用于限制本公开的保护范围。
应当理解，本公开的方法实施方式中记载的各个步骤可以按照不同的顺序执行，和/或并行执行。此外，方法实施方式可以包括附加的步骤和/或省略执行示出的步骤。本公开的范围在此方面不受限制。
本文使用的术语“包括”及其变形是开放性包括，即“包括但不限于”。术语“基于”是“至少部分地基于”。术语“一个实施例”表示“至少一个实施例”；术语“另一实施例”表示“至少一个另外的实施例”；术语“一些实施例”表示“至少一些实施例”。其他术语的相关定义将在下文描述中给出。
需要注意，本公开中提及的“第一”、“第二”等概念仅用于对不同的装置、模块或单元进行区分，并非用于限定这些装置、模块或单元所执行的功能的顺序或者相互依存关系。
需要注意，本公开中提及的“一个”、“多个”的修饰是示意性而非限制性的，本领域技术人员应当理解，除非在上下文另有明确指出，否则应该理解为“一个或多个”。
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的，而并不是用于对这些消息或信息的范围进行限制。
如前所述，用户根据需求从应用中预设的变速模板中选择需要的模板进行套用的方式，并不能很好的满足用户的个性化变速调整需求。
自定义变速方式的调节过程是通过功能面板上几个控制点的拖拽调整速度曲线，但是调整一个控制点就会导致控制点两段区域的速度曲线跟着发生变化，导致音视频片段变速调整的准确率很低，效率也很差。
为了解决上述问题，本公开实施例提供了一种多媒体片段的速度调整方法。在该方法中，通过将多媒体素材划分为多个区间。多个区间之间的视频帧播放速度独立调整互不关联，且在针对每个区间内的视频帧可以基于第一控制点实现播放速度的整体调整。也可以基于第二控制点实现对播放速度的变速调整，使得同一个区间内的不同视频帧的播放速度不同。从而，实现了对视频帧播放速度的精细化调整，且提升了视频帧播放速度调整的精确度和效率。
为了解决上述技术问题或者至少部分地解决上述技术问题，本公开提供了一种多媒体片段的速度调整方法、装置、设备及介质，以实现对视频帧播放速度的精细化调整，且提升了视频帧播放速度调整的精确度和效率。
下面结合实施例对该方法进行介绍。
图1为本公开实施例提供的一种多媒体片段的速度调整方法的流程示意图。该方法可以由多媒体片段的速度调整装置执行，其中该装置可以采用软件和/或硬件实现，一般可集成在电子设备中。如图1所示，该方法包括步骤101～103。
步骤101，在音视频编辑轨道上将多媒体素材片段分割成多个区间，。多个区间包括目标区间，以及在多媒体素材片段上设置有与目标区间对应的第一控制点和第二控制点。
容易理解的是，为了便于对音视频信息等多媒体素材的速度调整，在可视化界面 上显示音视频编辑轨道。该音视频编辑轨道与待调整的视频流相映射，轨道上不同的区间对应预视频流中不同的视频流段。音视频编辑轨道的显示可通过一些快捷键拉起，也可以通过触发预设的控件拉起等，在此不一一列举。
在本公开的实施例中，为了实现对视频流中视频帧播放速度的精细化调整，在音视频编辑轨道将多媒体素材划分成不同的区间。区间内对应的视频帧播放的初始速度，可以为分割前视频流的播放速度。
在一些实施例中，为了降低计算压力等，在将多媒体素材片段分割成多个区间时，还检测目标区间的视频帧数量是否小于预设的视频阈值，以避免视频流等多媒体素材被切分为过小的区间。多媒体素材被切分为过小的区间不但影响播放速度的调整效率，还会导致计算压力的增加。预设阈值可以根据实验数据标定，比如，可以为3等。如果检测获知视频帧数量小于视频阈值，则显示不能分割的提示信息，比如，弹窗显示“区间过小，无法添加”等消息。
本公开的一些实施例中，为了更加直观地区分不同的区间，可以采用分割点作为不同区间的区分标识。例如，分割点可以为任意指示将视频流划分为不同区间的标识，包括但不限于文字标识、字母标识、图案标识、颜色标识等中的一种或多种。
在一些实施例中，如图2所示，分割点为两个相对的梯形图案，对应的视频流被分割点划分为多个区间。例如，区间Q1和Q2中间包括分割点1，分割点1包括对应的两个梯形图案a1和a2。
为了实现对不同区间对应的视频帧播放速度的单独调整，在通过分割点划分为不同的区间后，将分割点的部分区域作为相邻的目标区间的第一控制点。该第一控制点用于将目标区间的速度调整与其他区间的速度调整进行分割处理。
在一些实施例中，为了保证区间中分割点显示的完整性，避免分割点的两个部分拆分显示，影响区间的分割显示效果，响应于对目标区间上第一吸附控制开关的开启操作(该第一吸附控制开关可以为显示在可视化界面上的控件等)，获取第一控制点在编辑轨道上移动操作的结束位置，并将结束位置与相邻的其他区间的分割位置吸附对齐。即保证跟随第一控制点的移动，在音视频编辑轨道上的其他分割点和区间整体跟随移动。
也即是说，第一控制点单独用于控制对应目标区间内的视频帧的播放速度，不同的区间对应不同的第一控制点，可以实现对不同的区间内的视频帧的播放速度的独立调整。
在不同的应用场景中，相邻的目标区间第一控制点的设置位置不同。
在一些实施例中，第一控制点设置在目标区间的结束位置。在本实施例中，若是基于分割点进行区间的分割，则由于分割点通常通过左右两个区域部分来限定出位于左右两个区域部分中间的区间。因此，可将分割点的左半部分区域，即目标区间的结束位置对应的分割点区域，作为与左边相邻的目标区间的第一控制点，如图3A所示；若是分割点为如上述图2所示时，对于分割点1来说，可以将位于左半部分区域-梯形图案a1作为第一控制点，该第一控制点用于控制与梯形图案a1相邻的左边区间Q1部分的视频帧播放速度。
在另一些实施例中，第一控制点设置在目标区间的起始位置。在本实施例中，若是基于分割点进行区间的分割，则由于分割点通常通过左右两个区域部分来限定出位于左右两个区域部分中间的区间。因此，可将分割点的左半部分区域，即目标区间的起始位置对应的分割点区域，作为与左边相邻的目标区间的第一控制点，如图3B所示；若是分割点为如上述图2所示时，对于分割点1来说，可以将位于右半部分区域-梯形图案a2作为第一控制点，该第一控制点用于控制与梯形图案a2右边相邻的区间Q2部分的视频帧播放速度。
在本实施例中，除了在多媒体素材片段上设置有与目标区间对应的第一控制点之外，还设置有第二控制点。例如，该第二控制点用于对目标区间内的视频帧的播放速度进行变速调整，第二控制点的有关说明参照后续实施例。
步骤102，响应于对第一控制点的移动操作，根据第一控制点在编辑轨道上的位置调整速度变化量，控制目标区间内视频帧的速度按照调整后的速度变化量进行变速，并根据速度变化后的播放时长对应伸缩调整目标区间在编辑轨道上的显示长度。
正如以上所说的，第一控制点用于调整目标区间内视频帧的播放速度，因此，响应于对第一控制点的移动操作，可以控制目标区间内的视频帧的播放速度。例如，第一控制点的移动操作可以是用户通过拖动触发的、语音触发的等，在此不一一列举。
在本公开的实施例中，响应于对第一控制点的移动操作，控制第一控制点在编辑轨道上移动；根据第一控制点在编辑轨道上的位置调整速度变化量，控制目标区间相关的视频帧的速度按照调整后的速度变化量进行变换。
即在本实施例中，基于第一控制点控制目标区间内包含的视频帧的播放速度的整体变化，整体速度的变化程度取决于第一控制点在编辑轨道上移动的长度等。
为了直观地指示目标区间内视频帧播放时长，可以根据速度变化后的播放时长对 应伸缩调整目标区间在编辑轨道上的显示长度。例如，为了进一步提升调整的直观性，还可以对正在调整的目标区间进行视觉增强显示，比如，采用矩形框框起当前目标区间在音视频编辑轨道上的区域，并高亮显示矩形框等。
需要说明的是，在不同的应用场景中，响应于对第一控制点的移动操作，根据第一控制点在编辑轨道上的位置调整速度变化量的方式不同，示例如下。
在一些实施例中，若是将目标区间的结束位置作为与左边相邻的目标区间的第一控制点，则响应于对第一控制点的向右移动操作，控制目标区间结束点在编辑轨道上的位置向右拉伸；根据第一控制点在编辑轨道上的位置减小速度变化量。目标区间起始点在编辑轨道上位置不变。
也即是说，在本实施例中，每个目标区间对应的视频帧是不变的，调整第一控制点以改变目标区间结束点在编辑轨道上的位置，将目标区间结束点在编辑轨道上的位置向右拉伸，可以等同于延长目标区间对应的视频帧的播放时长。从而，相当于降低了目标区间内视频帧的播放速度，根据第一控制点在编辑轨道上的位置减小速度变化量来降低目标区间内视频帧的播放速度。
举例而言，如图4A所示，对于目标区间Q3来说，响应于对第一控制点的向右移动操作，控制目标区间结束点在编辑轨道上的位置向右拉伸；根据第一控制点在编辑轨道上的位置减小速度变化量。比如，目标区间结束点在编辑轨道上的位置向右拉伸了L1，则速度变化量减小了0.5X，从而，目标区间内视频帧播放速度由原有的1X降低为0.5X。
或者，在本实施例中，响应于对第一控制点的向左移动操作，控制目标区间结束点在编辑轨道上的位置向左缩短；根据第一控制点在编辑轨道上的位置增加速度变化量，目标区间起始点在编辑轨道上位置不变。
也即是说，在本实施例中，每个目标区间对应的视频帧是不变的，调整第一控制点以改变目标区间结束点在编辑轨道上的位置，将目标区间结束点在编辑轨道上的位置向左缩短，可以等同于缩短目标区间对应的视频帧的播放时长。从而，相当于提升了目标区间内视频帧的播放速度，根据第一控制点在编辑轨道上的位置增加速度变化量来提升目标区间内视频帧的播放速度。
举例而言，如图4B所示，对于目标区间Q3来说，响应于对第一控制点的向左移动操作，控制目标区间结束点在编辑轨道上的位置向左缩短；根据第一控制点在编辑轨道上的位置增加速度变化量。比如，目标区间结束点在编辑轨道上的位置向左缩短 了L2，则速度变化量增加了0.25X，从而，目标区间内视频帧播放速度由原有的1X提升为1.25X。
在一些实施例中，若是将目标区间的起始位置作为与右边相邻的目标区间的第一控制点，则响应于对第一控制点的向右移动操作，控制目标区间起始点在编辑轨道上的位置向右缩短；根据第一控制点在编辑轨道上的位置增加速度变化量，目标区间结束点在编辑轨道上位置不变。
也即是说，在本实施例中，每个目标区间对应的视频帧是不变的，调整第一控制点以改变目标区间起始点在编辑轨道上的位置，将目标区间起始点在编辑轨道上的位置向右缩短，可以等同于缩短目标区间对应的视频帧的播放时长。从而，相当于提升了目标区间内视频帧的播放速度，根据第一控制点在编辑轨道上的位置增加速度变化量来提升目标区间内视频帧的播放速度。
举例而言，如图5A所示，对于目标区间Q4来说，响应于对第一控制点的向右移动操作，控制目标区间起始点在编辑轨道上的位置向右缩短；根据第一控制点在编辑轨道上的位置增加速度变化量。比如，目标区间起始点在编辑轨道上的位置向右缩短了L3，则速度变化量增加了0.25X，从而，目标区间内视频帧播放速度由原有的1X提升为1.25X。
或者，在本实施例中，响应于对第一控制点的向左移动操作，控制目标区间起始点在编辑轨道上的位置向左拉伸，根据第一控制点在编辑轨道上的位置减小速度变化量，目标区间结束点在所述编辑轨道上位置不变。
也即是说，在本实施例中，每个目标区间对应的视频帧是不变的，调整第一控制点以改变目标区间起始点在编辑轨道上的位置，将目标区间起始点在编辑轨道上的位置向左拉伸，可以等同于提升目标区间对应的视频帧的播放时长。从而，相当于降低了目标区间内视频帧的播放速度，根据第一控制点在编辑轨道上的位置减小速度变化量来降低目标区间内视频帧的播放速度。
举例而言，如图5B所示，对于目标区间Q4来说，响应于对第一控制点的向左移动操作，控制目标区间起始点在编辑轨道上的位置向左拉伸，根据第一控制点在编辑轨道上的位置减小速度变化量。比如，目标区间起始点在编辑轨道上的位置向左拉伸了L4，则速度变化量减小了0.25X，从而，目标区间内视频帧播放速度由原有的1X降低为0.75X。
步骤103，响应于对目标区间上第二控制点的移动操作，根据第二控制点在目标 区间上的位置调整速度曲线的斜率，控制目标区间内视频帧的速度按照斜率调整后的速度曲线进行变速。
由于上述第一控制点仅仅用于控制目标区间中视频帧整体的播放速度，比如，如图6A所示，若是目标区间内包含了10帧视频帧，且10帧视频帧的播放速度均相同，为匀速变化，则基于第一控制点可以实现的效果是控制10帧视频帧的播放速度整体提升或者整体缩短。，每帧视频帧的播放速度是相同的(图中以视频帧的显示宽度体现视频帧的播放速度)。
而在一些实施例中，若是用户具有对视频帧的变速调整需求，则上述仅仅基于第一控制点进行播放速度调整的方式显示精细化程度不高。比如，如图6B所示，若是目标区间内包含了10帧视频帧，用户希望这10帧视频帧的播放速度逐渐降低或者是逐渐提升(图中以视频帧的显示宽度体现视频帧的播放速度)。
在本公开的一些实施例中，为了满足上述对视频帧的变速调整需求，还设置了针对目标区间的第二控制点。该第二控制点可视化的显示，包括但不限于文字标识、字母标识、图案标识、颜色标识等中的一种或多种。
在本实施例中，根据第二控制点在目标区间上的位置调整速度曲线的斜率，控制目标区间内视频帧的速度按照斜率调整后的速度曲线进行变速。
在本实施例中，如图7所示，速度曲线的纵轴对应于播放速度，横轴对应于目标区间的视频帧。从而，速度曲线的斜率可以决定目标区间内视频帧的播放速度，可精细化到视频帧实现对播放速度的变速调整。例如，参照图7，速度曲线越是陡峭，则对应的播放速度的变化率越大；反之，速度曲线越是平缓，则对应的播放速度的变化率越低。
在不同的应用场景中，根据第二控制点在目标区间上的位置调整速度曲线的斜率的方式不同，不同的调整方式参见后续实施例，在此不再赘述。
此处需要强调的是，由于第一控制点主要用于：对对应的目标区间内视频帧的播放速度进行整体的控制。因此，如上述图6A所示，若是在目标区间内的视频帧为匀速播放的情况下，控制目标区间内的视频帧的速度都按照调整后的速度变化量变快或变慢进行匀速播放。
但是，若是目标区间内的视频帧经过第二控制点的控制，已经实现了变速变化，则基于第一控制点实现的效果也是以变速为基础的整体变化。即在目标区间内的视频帧为根据速度曲线非匀速播放的情况下，控制目标区间内的视频帧的速度都按照调整 后的速度变化量变快或变慢进行非匀速播放。
比如，如图6C所示，若是目标区间内包含了10帧视频帧，这10帧视频帧的根据速度曲线确定的播放速度逐渐降低。若基于第一控制点的移动操作确定的对应的速度变化量为速度降低0.5X，则在维持这10帧视频帧的播放速度逐渐降低的基础上，根据该0.5X降低整体播放速度。
综上，本公开实施例提供的多媒体片段的速度调整方法，在音视频编辑轨道上将多媒体素材片段分割成多个区间。例如，多个区间包括目标区间，以及在多媒体素材片段上设置有与目标区间对应的第一控制点和第二控制点。响应于对第一控制点的移动操作，根据第一控制点在编辑轨道上的位置调整速度变化量，控制目标区间内视频帧的速度按照调整后的速度变化量进行变速；并根据速度变化后的播放时长对应伸缩调整目标区间在编辑轨道上的显示长度；响应于对目标区间上第二控制点的移动操作，根据第二控制点在目标区间上的位置调整速度曲线的斜率，控制目标区间内视频帧的速度按照斜率调整后的速度曲线进行变速。由此，通过将多媒体素材划分为多个区间，多个区间之间的视频帧播放速度独立调整互不关联，且在针对每个区间内的视频帧可以基于第一控制点实现播放速度的整体调整。也可以基于第二控制点实现对播放速度的变速调整，使得同一个区间内的不同视频帧的播放速度不同。从而，实现了对视频帧播放速度的精细化调整，且提升了视频帧播放速度调整的精确度和效率。
正如以上附图所体现的，为了保证速度调节的直观性，提升速度调节的情况，还可以在功能面板区域关联显示与多媒体素材片段对应的示意图。例如，该示意图包括与以及与第一控制点对应的速度控制标识，并在示意区间对应区域显示根据第一控制点对目标区间调整后的速度。由此，基于示意图与音视频编辑轨道的联动显示，可以直观的展示出当前的第一控制点的速度调整情况。
举例而言，参照图8A，在功能面板区域关联显示与多媒体素材片段示意图。示意图包括与第一控制点对应的速度控制标识，与目标区间Qs对应的示意区间Qs’。将第一控制点a2s作为相邻的示意区间的速度控制标识，并在示意区间Qs’对应区域显示根据第一控制点对目标区间调整后的速度，图中调整后的速度为0.5X。
在本公开的一些实施例中，同样的在示意图上联动显示根据第二控制点调整后的速率，即根据第二控制点在目标区间的位置调整速度曲线的斜率；并在示意区间关联显示斜率调整后的速度曲线以及速度曲线的速度区间值。
举例而言，参照图8B所示，第二控制点在目标区间Qs的位置由中心位置移动到 目标区间的结束位置，则根据第二控制点在目标区间的位置调整速度曲线的斜率，得到的速度曲线S1以及速度区间值如图中所示。用户可以直观的看到变速调节结果。
在本公开的一些实施例中，响应于编辑草稿的存储操作，将相邻的示意区间的速度控制标识对应的速度进行比较。当左侧区间结束位置的速度控制标识对应的速度与右侧区间开始位置的速度控制标识对应的速度相同时，如图9A所示，将两个速度控制标识合并存储为用于在移动设备显示的一个速度控制点；当左侧区间结束位置的速度控制标识对应的速度与右侧区间开始位置的速度控制标识对应的速度不同时，如图9B所示，可将两个速度控制标识分别存储为用于在移动设备显示的两个速度控制点。
在一些实施例中，为了进一步便于用户调整的便利性，可以将示意图作为草稿存储后，可同步显示到其他设备上。比如，将在PC端调整后的示意图同步到手机设备上进行显示等。
在本公开的一些实施例中，若是同步到手机等移动终端上有关示意图，用户可以在移动终端上对示意图进行操作；若是第一控制点通过分割点的部分区域标识，则在本实施例中，对于包含两个区域的分割点而言，可以在移动终端上以其他图案显示。即在移动终端上进行转换显示，以适应移动终端的显示规则。
比如，如图10A所示，在移动终端上，以圆点形式显示分割点不同的区域。若是检测到用户拖动其中一个圆点，则可以变更该点x轴坐标，两点间隔m个像素；若是同步到PC段后，对应的两个圆点显示为分割点的不同区域。但是由于在pc端分割点的不同区域的间隔为1帧，区间中包含的最低视频帧数量也有限制。比如，不能小于3帧，则如在移动端拖动的圆点对应的x轴与PC端的显示规则有冲突时，可在交互后丢弃该圆点，不在PC端显示该圆点对应的分割点区域等。
在一些实施例中，在将移动终端侧调整后的示意图同步回PC端时，x轴间距＝1帧时，如图10B所示，移动端两点合并显示为一个完整的分割点，多出的圆点不合并。如abc三点间隔都为1帧，ab合并显示为一个完整的分割点，c独立显示为一个分割点的部分区域，x轴间距不等于1帧时，一个圆点显示为分割点的部分区域。当同步到PC端后出现视频帧小于预设的最低视频帧数量的区间时，如图10C所示，可以视频帧小于预设的最低视频帧数量的区间中第一个分割点区域保留，将其他分割点区域删除等。
综上，本公开实施例的多媒体片段的速度调整方法，在功能面板区域关联显示与多媒体素材片段对应的示意图。在示意图包括与目标区间对应的示意区间，在示意图 中示意区间对应区域显示第一控制点以及第二控制点对目标区间的速度调整结果，提升了速度调整的直观性，提升了速度调整的用户体验。
基于上述实施例，上述第二控制点的触发操作用于控制目标区间中视频帧的变速变化，第二控制点决定了变速变化的速度曲线的斜率，下面就如何根据第二控制点在目标区间上的位置调整速度曲线的斜率进行示例性说明。
在本公开的一些实施例中，响应于对目标区间上第二控制点的触发操作，根据第二控制点在目标区间上的位置调整速度曲线的斜率，包括下面的步骤。
响应于对目标区间上第二控制点的添加操作，根据第二控制点在目标区间上的添加位置调整速度曲线的斜率。在本实施例中，第二控制点设置在目标区域间上的位置不同，则对应的斜率不同。比如，响应于第二控制点位于目标区间的中间位置时，调整速度曲线的斜率为零生成与第一控制点所调整的速度匹配的匀速直线，进而控制目标区间内的视频帧的速度按照匀速直线进行播放。
举例而言，如图11所示，若是第二控制点为显示在目标区间内的“圆点”时，则圆点设置在目标区间的位置决定了速度曲线的斜率；若是“圆点”设置在目标区间对应的轨道的中间位置，则对应的斜率为0，此时，目标区间内的视频帧匀速播放。
若是“圆点”向着在目标区间对应轨道的右边位置移动，则对应的斜率跟随变化，比如，速度曲线的平均斜率逐渐增大，此时，目标区间内的视频帧播放速度伴随斜率的变化而变化，实现了播放速度的调整；若是“圆点”向着在目标区间对应的轨道的左边位置移动，则对应的跟随斜率变化，比如，速度曲线的平均斜率逐渐降低，此时，目标区间内的视频帧播放速度伴随斜率的变化而变化，实现了播放速度的调整。
在本实施例中，还可响应于对第二控制点的移动操作，根据第二控制点在目标区间上的移动位置调整速度曲线的斜率，在响应于对目标区间上第二控制点的添加操作，根据第二控制点在目标区间上的添加位置调整速度曲线的斜率后，可以根据第二控制点在目标区间上的移动位置调整速度曲线的斜率，比如，若是第二控制点在目标区间上的添加位置对应的斜率为0，则伴随着第二控制点的向右移动操作，或者向左操作，可以调整速度曲线的斜率。
向右或者向左移动时，斜率的调整情况在不同的应用场景中不同：
在一些实施例中，获取目标区间上第二控制点移动的候选位置点，构建每个候选位置点与斜率的对应关系，不同的候选位置点之间的斜率的变化，可以和候选位置点的位置变化关联，也可以不关联在此不作限制。
在本实施例中，响应于对第二控制点的移动操作，确定第二控制点移动到的目标位置点，查询上述对应关系确定与目标位置点对应的斜率来调整速度曲线的斜率。
在另一些实施例中，响应于第二控制点位于中间位置与目标区间结束位置之间移动时，调整速度曲线的斜率生成上升速度曲线，第二控制点位于目标区间结束位置时，速度曲线对应的斜率值最大，即当第二控制点位于目标区间结束位置时，上升速度曲线整体越陡峭，此时斜率值最大可以理解为速度曲线的斜率值的均值最大。
可以理解，在本实施例中，第二控制点位于目标区间结束位置时，第二控制点位于目标区间结束位置时，目标区间的起始位置到中心位置的斜率变化率最大，进而控制目标区间内的视频帧的播放速度按照上升速度曲线进行播放。
即可以理解，在本实施例中，第二控制点越是靠近目标区间结束位置，则对应的上升速度曲线在起始位置到中心位置的斜率增大值则越大，将第二控制点的移动与斜率的增大关联起来，提升了操作的互动感。
第二控制点位于中间位置与目标区间的结束位置之间移动时，在保证生成上升趋势的曲线，以及目标区间的起始位置到中心位置的斜率逐渐增大的基础上，该上升速度曲线可以为任意形式，比如，如图12A所示，该斜率可以中心位置点为对称中心，在目标区间的起始位置到中心位置的斜率逐渐增大，在目标区间中心位置到结束位置的斜率逐渐减小等，在本实施例中，继续参照图12A，伴随着第二控制点靠近目标区间结束位置的程度，目标区间的起始位置到中心位置的斜率的变化率逐渐增大，若是第二控制点位于目标区间结束位置，目标区间的起始位置到中心位置的斜率变化率最大，此时，速度曲线对应的斜率值最大，速度曲线整体最为陡峭。
又比如，如图12B所示，该斜率可以为斜率为正的正弦波曲线，从目标区间的起始位置到结束位置，速度曲线的斜率逐渐降低，继续参照图12B，伴随着第二控制点靠近目标区间结束位置的程度，目标区间的起始位置到中心位置的斜率的变化率逐渐增大，若是第二控制点位于目标区间结束位置，速度曲线的斜率值最大。
在本公开的一些实施例中，响应于第二控制点位于中间位置与目标区间起始位置之间移动时，调整速度曲线的斜率生成下降速度曲线，第二控制点位于目标区间起始位置时，第二控制点位于目标区间起始位置时，速度曲线对应的斜率值最小，进而控制目标区间内的视频帧的播放速度按照下降速度曲线进行播放。在本实施例中，由于下降速度曲线的斜率为负值，因此，速度曲线对应的斜率值最小时，速度曲线的越是陡峭，此时斜率值的最小可以理解为速度曲线包含的每个点的斜率值的均值最小等。
即可以理解，在本实施例中，第二控制点越是靠近目标区间起始位置，则对应的下降速度曲线在起始位置到中心位置的斜率绝对值的增大值则越大，将第二控制点的移动与斜率的增大关联起来，提升了操作的互动感。
第二控制点在中间位置向目标区间的起始位置移动时，在保证生成下降趋势曲线，以及目标区间的起始位置到中心位置的斜率的绝对值逐渐增大的基础上，该下降速度曲线可以为任意形式，比如，如图13A所示，该斜率可以中心位置点为对称中心，在目标区间的起始位置到中心位置的斜率的绝对值逐渐增大，在目标区间中心位置到结束位置的斜率的绝对值逐渐减小等，在本实施例中，继续参照图13A，伴随着第二控制点靠近目标区间起始位置的程度，目标区间的起始位置到中心位置的斜率的绝对值的变化率逐渐增大，若是第二控制点位于目标区间起始位置，则为负值的速度曲线斜率值最小，速度曲线最陡峭。
又比如，如图13B所示，该斜率可以为斜率为负的正弦波曲线，从目标区间的起始位置到结束位置，速度曲线的斜率的绝对值逐渐增大，继续参照图13B，伴随着第二控制点靠近目标区间起始位置的程度，目标区间的起始位置到中心位置的斜率的变化率逐渐增大，若是第二控制点位于目标区间起始位置，则为负值的速度曲线斜率值最小，速度曲线最陡峭。
为了避免上述速度调整范围过大导致视频帧的播放效果不佳，比如，可能会导致速度变化过快或者过慢等，在本公开的一个实施例中，还限定速度曲线的速度区间值，基于速度区间值限定出速度调整范围。
在本实施例中，根据第一控制点所调整的速度，以及预设的与调整后的速度曲线斜率对应的倍速范围，确定调整后的速度曲线的速度区间值，将速度区间值显示在第二控制点在目标区间位置的预设区域内，显示方式可以为标签显示、悬浮显示等任意形式，用于指示当前第二控制点对应的调整速度范围。
当区间速度为匀速时，在目标区间位置的预设区域内展示“变速n.nX”，当区间速度为变速时在目标区间位置的预设区域内展示“变速a.aX～b.bX”，a.a为起始位置的速度，b.b为结束位置的速度。
在一些实施例中，可以根据第一控制点所调整的速度与速度曲线斜率对应的倍速范围中边界值的接近程度，来确定调整后的速度曲线的速度区间值，比如，将第一控制点所调整的速度作为中心位置，将接近的边界值作为速度区间的一个边界等。
举例而言，如图14所示，若是第一控制点所调整的速度为0.5X，预设的倍速范 围为0.1X-10X，则分别计算1X和0.5X的第一倍数，以及10X与0.5X的第二倍数，基于第一倍数和第二倍数确定出较小的倍数即第一倍数对应的边界值为0.1X，因此，以0.1X为边界值，以0.5X为中心值，确定速度曲线的速度区间值为0.1X-1X。
在另一些实施例中，在获取到第一控制点所调整的速度后，计算该速度和预设的调整值之间的求和值，以及第一控制点和该预设的调整值的求差值，将求和值和求差值分别作为速度区间值的最大区间边界值和最小区间边界值，以确定调整后的速度曲线的速度区间值。
若是该求差值小于预设的与调整后的速度曲线斜率对应的倍速范围的最小值，则将倍速范围的最小值作为速度区间值的最小区间边界值，同样的，若是求和值之和大于预设的与调整后的速度曲线斜率对应的倍速范围的最大值，则将倍速范围的最大值作为速度区间值的最大区间边界值，
在上述基于第二控制点在目标区间内的拖动操作进行斜率调整时，为了提升调整的直观性，还基于视频帧实时显示对应的调整效果。
在本实施例中，响应于对第二控制点在目标区间内的拖动操作，对目标区间内进行速度调整的视频帧进行变速调整状态的显示，根据斜率调整后的速度曲线，将目标区间内速度变慢的视频帧拉宽显示，以及将目标区间内速度变快的视频帧压窄显示，通过视频帧的宽窄体现对应的视频帧的速度调整情况。在实际执行过程中，在调整完毕后，可以采用抽帧显示的方式正常显示对应的视频帧等，在此不作限制。
举例而言，如图15所示，若是第二控制点在目标区间的中间位置时，视频帧播放速度为匀速的0.5X，每一帧视频帧的宽度相同；若是用户将第二控制点拖动到目标区间的结束位置，则根据斜率调整后的速度曲线，将目标区间内速度变慢的视频帧拉宽显示，以及将目标区间内速度变快的视频帧压窄显示。
另外，在一些实施例中，为了提升视频播放的顺滑感，在不同区间内的相接处的速度接近时，可以将速度进行对齐。
在本公开的一些实施例中，响应于第二吸附控制开启操作，第二吸附控制开关可以为可视化的控件等，根据第二控制点在目标区间上的位置获取斜率调整后的速度曲线，根据斜率调整后的速度曲线确定目标区间结束位置的播放速度，如果目标区间结束位置的播放速度与相邻区间开始位置的播放速度的差值小于预设阈值，预设阈值根据实验数据标定，则将目标区间结束位置与相邻区间开始位置的速度调整对齐，由此，在满足用户对播放速度个性化需求的基础上，保证了视频播放的顺滑感。
举例而言，如图16所示，若是目标区间Qi的结束位置o2的播放速度，与相邻区间Q(i+1)的起始位置w1的播放速度的差值小于预设阈值，则将目标区间结束位置与相邻区间开始位置的速度调整对齐。
综上，本公开实施例的多媒体片段的速度调整方法，根据应用场景的不同，灵活根据第二控制点的移动操作确定速度曲线的斜率，满足了对目标区间内视频帧的播放速度的变速调节需求，提升了调节的灵活性。
为了实现上述实施例，本公开还提供了一种多媒体片段的速度调整装置。
图17为本公开实施例提供的一种多媒体片段的速度调整装置的结构示意图，该装置可由软件和/或硬件实现，一般可集成在电子设备中进行音视频信息的速度调整。如图17所示，该装置包括：划分模块1710、第一变速控制模块1720和第二变速控制模块1730。
划分模块1710，用于在音视频编辑轨道上将多媒体素材片段分割成多个区间，多个区间包括目标区间，以及在多媒体素材片段上设置有与目标区间对应的第一控制点和第二控制点。
第一变速控制模块1720，用于响应于对第一控制点的移动操作，根据所述第一控制点在编辑轨道上的位置调整速度变化量，控制目标区间内视频帧的速度按照调整后的速度变化量进行变速，并根据速度变化后的播放时长对应伸缩调整目标区间在编辑轨道上的显示长度。
第二变速控制模块1730，用于响应于对第二控制点的移动操作，根据第二控制点在目标区间上的位置调整速度曲线的斜率，控制目标区间内的视频帧速度按照斜率调整后的速度曲线进行变速。
本公开实施例所提供的多媒体片段的速度调整装置可执行本公开任意实施例所提供的多媒体片段的速度调整方法，具备执行方法相应的功能模块和有益效果。
为了实现上述实施例，本公开还提出一种计算机程序产品，包括计算机程序/指令，该计算机程序/指令被处理器执行时实现上述实施例中的多媒体片段的速度调整方法。
图18为本公开实施例提供的一种电子设备的结构示意图。
下面参考图18，其示出了适于用来实现本公开实施例中的电子设备1800的结构示意图。本公开实施例中的电子设备1800可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字TV、台 式计算机等等的固定终端。图18示出的电子设备仅仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。
如图18所示，电子设备1800可以包括处理器(例如中央处理器、图形处理器等)1801，其可以根据存储在只读存储器(ROM)1802中的程序或者从存储器1808加载到随机访问存储器(RAM)1803中的程序而执行各种适当的动作和处理。在RAM 1803中，还存储有电子设备1800操作所需的各种程序和数据。处理器1801、ROM 1802以及RAM 1803通过总线1804彼此相连。输入/输出(I/O)接口1805也连接至总线1804。
通常，以下装置可以连接至I/O接口1805：包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置1806；包括例如液晶显示器(LCD)、扬声器、振动器等的输出装置1807；包括例如磁带、硬盘等的存储器1808；以及通信装置1809。通信装置1809可以允许电子设备1800与其他设备进行无线或有线通信以交换数据。虽然图18示出了具有各种装置的电子设备1800，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
例如，根据本公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在非暂态计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中，该计算机程序可以通过通信装置1809从网络上被下载和安装，或者从存储器1808被安装，或者从ROM 1802被安装。在该计算机程序被处理器1801执行时，执行本公开实施例的多媒体片段的速度调整方法中限定的上述功能。
需要说明的是，本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。 这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、RF(射频)等等，或者上述的任意合适的组合。
在一些实施方式中，客户端、服务器可以利用诸如HTTP(HyperText Transfer Protocol，超文本传输协议)之类的任何当前已知或未来研发的网络协议进行通信，并且可以与任意形式或介质的数字数据通信(例如，通信网络)互连。通信网络的示例包括局域网(“LAN”)，广域网(“WAN”)，网际网(例如，互联网)以及端对端网络(例如，ad hoc端对端网络)，以及任何当前已知或未来研发的网络。
上述计算机可读介质可以是上述电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。
上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被该电子设备执行时，使得该电子设备。
在音视频编辑轨道上将多媒体素材片段分割成多个区间，多个区间包括目标区间，以及在多媒体素材片段上设置有与目标区间对应的第一控制点和第二控制点，响应于对第一控制点的移动操作，根据第一控制点在编辑轨道上的位置调整速度变化量，控制目标区间内视频帧的速度按照调整后的速度变化量进行变速，并根据速度变化后的播放时长对应伸缩调整目标区间在编辑轨道上的显示长度，响应于对目标区间上第二控制点的移动操作，根据第二控制点在目标区间上的位置调整速度曲线的斜率，控制目标区间内视频帧的速度按照斜率调整后的速度曲线进行变速。由此，通过将多媒体素材划分为多个区间，多个区间之间的视频帧播放速度独立调整互不关联，且在针对每个区间内的视频帧可以基于第一控制点实现播放速度的整体调整，也可以基于第二控制点实现对播放速度的变速调整，使得同一个区间内的不同视频帧的播放速度不同，从而，实现了对视频帧播放速度的精细化调整，且提升了视频帧播放速度调整的精确度和效率。电子设备可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括但不限于面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计 算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
本公开实施例还提供了一种计算机程序，包括指令，所述指令当由处理器执行时使所述处理器执行本公开实施例提供的媒体片段的速度调整方法。
附图中的流程图和框图，图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的单元可以通过软件的方式实现，也可以通过硬件的方式来实现。单元的名称在某种情况下并不构成对该单元本身的限定。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人 员应当理解，本公开中所涉及的公开范围，并不限于上述技术特征的特定组合而成的技术方案，同时也应涵盖在不脱离上述公开构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。
此外，虽然采用特定次序描绘了各操作，但是这不应当理解为要求这些操作以所示出的特定次序或以顺序次序执行来执行。在一定环境下，多任务和并行处理可能是有利的。同样地，虽然在上面论述中包含了若干具体实现细节，但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实施例中。相反地，在单个实施例的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多个实施例中。
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题，但是应当理解所附权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反，上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。

Claims (19)

  1. 一种多媒体片段的速度调整方法，包括：
    在音视频的编辑轨道上，将多媒体素材片段分割成多个区间，其中，所述多个区间包括目标区间，以及在所述多媒体素材片段上设置有与所述目标区间对应的第一控制点和第二控制点；
    响应于对所述第一控制点的移动操作，根据所述第一控制点在所述编辑轨道上的位置调整速度变化量，控制所述目标区间内视频帧的速度按照调整后的速度变化量进行变速，并根据速度变化后的播放时长，对应伸缩调整所述目标区间在所述编辑轨道上的显示长度；
    响应于对所述第二控制点的移动操作，根据所述第二控制点在所述目标区间上的位置调整速度曲线的斜率，控制所述目标区间内的视频帧的速度按照斜率调整后的速度曲线进行变速。
  2. 根据权利要求1所述的速度调整方法，其中，所述第一控制点设置在所述目标区间的结束位置，
    所述响应于对所述第一控制点的移动操作，根据所述第一控制点在所述编辑轨道上的位置调整速度变化量，包括：
    响应于对所述第一控制点的向右移动操作，控制所述目标区间结束点在所述编辑轨道上的位置向右拉伸，根据所述第一控制点在所述编辑轨道上的位置减小速度变化量，其中，所述目标区间起始点在所述编辑轨道上位置不变，或者，
    响应于对所述第一控制点的向左移动操作，控制所述目标区间结束点在所述编辑轨道上的位置向左缩短，根据所述第一控制点在所述编辑轨道上的位置增加速度变化量，其中，所述目标区间起始点在所述编辑轨道上位置不变。
  3. 根据权利要求1或2所述的速度调整方法，其中，所述第一控制点设置在所述目标区间的起始位置，
    所述响应于对所述第一控制点的移动操作，根据所述第一控制点在所述编辑轨道上的位置调整速度变化量，包括：
    响应于对所述第一控制点的向右移动操作，控制所述目标区间起始点在所述编辑轨道上的位置向右缩短，根据所述第一控制点在所述编辑轨道上的位置增加速度变化量，其中，所述目标区间结束点在所述编辑轨道上位置不变，或者，
    响应于对所述第一控制点的向左移动操作，控制所述目标区间起始点在所述编辑轨道上的位置向左拉伸，根据所述第一控制点在所述编辑轨道上的位置减小速度变化量，其中，所述目标区间结束点在所述编辑轨道上位置不变。
  4. 根据权利要求1-3任一项所述的速度调整方法，其中，所述控制所述目标区间内的视频帧速度按照调整后的速度变化量进行变速，包括：
    在所述目标区间内的视频帧为匀速播放的情况下，控制所述目标区间内的视频帧速度按照调整后的速度变化量，变快或变慢进行匀速播放；或者，
    在所述目标区间内的视频帧为根据速度曲线非匀速播放的情况下，控制所述目标区间内的视频帧速度按照调整后的速度变化量，变快或变慢进行非匀速播放。
  5. 根据权利要求1-4任一项所述的速度调整方法，还包括：
    响应于对所述目标区间的分割操作，检测所述目标区间的视频帧数量是否小于预设的视频阈值；
    如果检测获知所述视频帧数量小于所述视频阈值，则显示不能分割的提示信息。
  6. 根据权利要求1-5任一项所述的速度调整方法，还包括：
    响应于第一吸附控制开启操作，获取所述第一控制点在所述编辑轨道上移动操作的结束位置，并将所述结束位置与相邻的其他区间的分割位置吸附对齐。
  7. 根据权利要求1-6任一项所述的速度调整方法，其中，所述根据所述第二控制点在所述目标区间上的位置调整速度曲线的斜率，控制所述目标区间内的视频帧速度按照斜率调整后的速度曲线进行变速，包括：
    响应于所述第二控制点位于所述目标区间的中间位置时，调整所述速度曲线的斜率为零，以生成与所述第一控制点所调整的速度匹配的匀速直线；
    控制所述目标区间内的视频帧速度按照所述匀速直线进行播放。
  8. 根据权利要求7所述的速度调整方法，还包括：
    响应于所述第二控制点在所述中间位置与所述目标区间的结束位置之间移动，调整所述速度曲线的斜率，以生成上升速度曲线，在所述第二控制点位于所述目标区间结束位置的情况下，所述速度曲线对应的斜率值最大；
    控制所述目标区间内的视频帧播放速度按照所述上升速度曲线进行播放。
  9. 根据权利要求7或8所述的速度调整方法，还包括：
    响应于所述第二控制点在所述中间位置与所述目标区间的起始位置之间移动，调整所述速度曲线的斜率，以生成下降速度曲线，其中，在所述第二控制点位于所述目 标区间起始位置的情况下，所述速度曲线对应的斜率值最小；
    控制所述目标区间内的视频帧播放速度按照所述下降速度曲线进行播放。
  10. 根据权利要求1-9任一项所述的速度调整方法，还包括：
    根据所述第一控制点所调整的速度，以及预设的与调整后的所述速度曲线斜率对应的倍速范围，确定调整后的所述速度曲线的速度区间值；
    将所述速度区间值显示在所述第二控制点在所述目标区间位置的预设区域内。
  11. 根据权利要求1-10任一项所述的速度调整方法，还包括：
    响应于对所述第二控制点在所述目标区间内的拖动操作，对所述目标区间内进行速度调整的视频帧进行变速调整状态的显示；
    根据斜率调整后的速度曲线，将所述目标区间内速度变慢的视频帧拉宽显示，以及将所述目标区间内速度变快的视频帧压窄显示。
  12. 根据权利要求1-11任一项所述的速度调整方法，还包括：
    响应于第二吸附控制开启操作，根据所述第二控制点在所述目标区间上的位置获取斜率调整后的速度曲线；
    根据所述斜率调整后的速度曲线，确定所述目标区间结束位置的播放速度；
    如果所述目标区间结束位置的播放速度与相邻区间开始位置的播放速度的差值小于预设阈值，则将所述目标区间结束位置与所述相邻区间开始位置的速度调整对齐。
  13. 根据权利要求1-12任一项所述的速度调整方法，还包括：
    在功能面板区域关联显示与所述多媒体素材片段对应的示意图，其中，所述示意图包括与所述目标区间对应的示意区间以及与所述第一控制点对应的速度控制标识；
    在所述示意区间对应区域，显示根据所述第一控制点对所述目标区间调整后的速度。
  14. 根据权利要求13所述的速度调整方法，还包括：
    根据所述第二控制点在所述目标区间的位置，调整所述速度曲线的斜率；
    在所述示意区间，关联显示斜率调整后的速度曲线以及所述速度曲线的速度区间值。
  15. 根据权利要求13或14所述的速度调整方法，还包括：
    响应于编辑草稿的存储操作，将相邻的示意区间的所述速度控制标识对应的速度进行比较；
    在左侧区间结束位置的速度控制标识对应的速度与右侧区间开始位置的速度控 制标识对应的速度相同的情况下，将两个所述速度控制标识合并存储为用于在移动设备显示的一个速度控制点；
    在左侧区间结束位置的速度控制标识对应的速度与右侧区间开始位置的速度控制标识对应的速度不同的情况下，将两个所述速度控制标识分别存储为用于在移动设备显示的两个速度控制点。
  16. 一种多媒体片段的速度调整装置，包括：
    划分模块，用于在音视频的编辑轨道上将多媒体素材片段分割成多个区间，其中，所述多个区间包括目标区间，以及在所述多媒体素材片段上设置有与所述目标区间对应的第一控制点和第二控制点；
    第一变速控制模块，用于响应于对所述第一控制点的移动操作，根据所述第一控制点在所述编辑轨道上的位置调整速度变化量，控制所述目标区间内视频帧的速度按照调整后的速度变化量进行变速，并根据速度变化后的播放时长，对应伸缩调整所述目标区间在所述编辑轨道上的显示长度；
    第二变速控制模块，用于响应于对所述第二控制点的移动操作，根据所述第二控制点在所述目标区间上的位置调整速度曲线的斜率，控制所述目标区间内的视频帧速度按照斜率调整后的速度曲线进行变速。
  17. 一种电子设备，包括：
    处理器；
    用于存储所述处理器可执行指令的存储器；
    所述处理器，用于从所述存储器中读取所述可执行指令，并执行所述可执行指令以实现上述权利要求1-15中任一所述的多媒体片段的速度调整方法。
  18. 一种计算机可读存储介质，存储有计算机程序，所述计算机程序由处理器执行时使所述处理器执行上述权利要求1-15中任一所述的多媒体片段的速度调整方法。
  19. 一种计算机程序，包括：
    指令，所述指令当由处理器执行时使所述处理器执行根据权利要求1-15中任一项所述的媒体片段的速度调整方法。
PCT/CN2023/097371 2022-06-01 2023-05-31 多媒体片段的速度调整方法、装置、设备及介质 WO2023232066A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210622737.1 2022-06-01
CN202210622737.1A CN117201716A (zh) 2022-06-01 2022-06-01 多媒体片段的速度调整方法、装置、设备及介质

Publications (1)

Publication Number Publication Date
WO2023232066A1 true WO2023232066A1 (zh) 2023-12-07

Family

ID=88987464

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/097371 WO2023232066A1 (zh) 2022-06-01 2023-05-31 多媒体片段的速度调整方法、装置、设备及介质

Country Status (2)

Country Link
CN (1) CN117201716A (zh)
WO (1) WO2023232066A1 (zh)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112738627A (zh) * 2020-12-23 2021-04-30 上海哔哩哔哩科技有限公司 播放控制方法及装置
CN113825019A (zh) * 2020-06-19 2021-12-21 北京字节跳动网络技术有限公司 视频变速播放方法、装置、电子设备及计算机可读介质
CN114449313A (zh) * 2022-02-10 2022-05-06 上海幻电信息科技有限公司 视频的音画面播放速率调整方法及装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113825019A (zh) * 2020-06-19 2021-12-21 北京字节跳动网络技术有限公司 视频变速播放方法、装置、电子设备及计算机可读介质
WO2021254443A1 (zh) * 2020-06-19 2021-12-23 北京字节跳动网络技术有限公司 视频变速播放方法、装置、电子设备及计算机可读介质
CN112738627A (zh) * 2020-12-23 2021-04-30 上海哔哩哔哩科技有限公司 播放控制方法及装置
CN114449313A (zh) * 2022-02-10 2022-05-06 上海幻电信息科技有限公司 视频的音画面播放速率调整方法及装置

Also Published As

Publication number Publication date
CN117201716A (zh) 2023-12-08

Similar Documents

Publication Publication Date Title
US10635379B2 (en) Method for sharing screen between devices and device using the same
WO2020108339A1 (zh) 一种页面显示位置跳转方法、装置，终端设备及存储介质
WO2020253453A1 (zh) 图像切换方法、装置、电子设备及存储介质
US11997356B2 (en) Video page display method and apparatus, electronic device and computer-readable medium
WO2021238679A1 (zh) 视频通话界面显示控制方法、装置、存储介质及设备
US9798512B1 (en) Context-based volume adjustment
JP7402330B2 (ja) 目標対象表示方法、装置、電子機器、及びコンピュータ読み取り可能な媒体
WO2023273854A9 (zh) 控件显示方法、装置、设备及介质
WO2023134492A1 (zh) 页面的显示方法、装置、电子设备、存储介质和程序产品
WO2021147461A1 (zh) 展示字幕信息的方法、装置、电子设备和计算机可读介质
WO2023011318A1 (zh) 媒体文件处理方法、装置、设备、可读存储介质及产品
WO2022183887A1 (zh) 视频编辑及播放方法、装置、设备、介质
CN113094135A (zh) 页面显示控制方法、装置、设备及存储介质
WO2023116480A1 (zh) 多媒体内容的发布方法、装置、设备、介质和程序产品
WO2022242482A1 (zh) 播放控制方法、设备、存储介质及程序产品
WO2022179409A1 (zh) 控件显示方法、装置、设备及介质
WO2022237202A1 (zh) 字幕信息编辑方法及装置
WO2024037480A1 (zh) 交互方法、装置、电子设备和存储介质
WO2024001893A1 (zh) 素材展示方法、装置、设备、计算机可读存储介质及产品
WO2023236875A1 (zh) 页面显示方法、装置、设备、计算机可读存储介质及产品
WO2023232066A1 (zh) 多媒体片段的速度调整方法、装置、设备及介质
WO2023217081A1 (zh) 信息输入页面的元素控制方法、装置、设备、介质
WO2021073206A1 (zh) 视频预览的方法、装置、存储介质及电子设备
WO2023088484A1 (zh) 用于多媒体资源剪辑场景的方法、装置、设备及存储介质
WO2023056925A1 (zh) 文档内容更新方法、装置和电子设备

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2023579684

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23815243

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023815243

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2023815243

Country of ref document: EP

Effective date: 20240329