CN113315883B

CN113315883B - Method and device for adjusting video combined material

Info

Publication number: CN113315883B
Application number: CN202110586359.1A
Authority: CN
Inventors: 洪嘉慧
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2021-05-27
Filing date: 2021-05-27
Publication date: 2023-01-20
Anticipated expiration: 2041-05-27
Also published as: CN113315883A

Abstract

The present disclosure relates to a method and an apparatus for adjusting video composite material, wherein the method for adjusting video composite material comprises: splitting a selected combined material into at least one material element when an individual editing mode is executed for the combined material in a video editing process; and editing one of the at least one material element according to the user input.

Description

Method and device for adjusting video combined material

Technical Field

The present disclosure relates to the field of video technologies, and in particular, to a method and an apparatus for adjusting video combined material.

Background

At present, various video and image editing software has been developed, but with the continuous rising of the demands of people for video and image editing, the existing video and image editing software cannot meet the demands of people. For example, existing video editing-type software available on a mobile terminal can provide a variety of combined materials to facilitate group calling by junior users, but they can only provide overall adjustment for the combined materials, cannot individually adjust the picture position, appearance time, size, hierarchical relationship, and the like of a certain material in the combined materials, and when a plurality of material tracks exist in a single-line hierarchical track, great inconvenience is brought when adjusting the position of a single material track due to limited screen space of the mobile terminal. In addition, the tracks of the combined material often cannot reflect the composition relationship between elements, and the tracks of the combined material can only be adjusted in the whole time, and the tracks of the material cannot reflect the real hierarchical relationship. In addition, although some existing applications can drag the rail to follow the hand and inform the user of where the rail will fall after the user releases his/her hand through the feedback of the "pre-falling position", the form is too complex, and when the material rail cannot be fallen at the current view position, the prompt of the "pre-falling position" may not be at the original position in the visible area, which is inconvenient for the user to perceive. In addition, although the existing image editing software available on the mobile terminal can select a certain part of materials for individual adjustment by clicking the picture by the user, when the combined elements are overlapped or the area in the picture is too small, the elements of the target part are difficult to select, and only the uppermost element can be selected in the overlapped area by clicking, and the selection is cancelled by clicking again; in addition, the image editing software can only adjust the position and the size of the element picture, and cannot meet the requirement of adjusting the time of the element, and the image editing software can only adjust the element independently and cannot adjust the whole combination. In addition, video and image editing software for large-screen computers also has various problems, for example, a track combination relationship is expressed in a multi-level expansion and retraction mode, which requires a large display area, a single line only has one material track, and the material is interfered by other materials when being edited independently (for example, a single material which is possibly edited is distributed at a bottom layer in a hierarchical manner and is covered by more materials outside the combination), or a single material in the combined material can only be adjusted in an original time period of the combined material, and the hierarchical relationship cannot be adjusted through gestures.

Disclosure of Invention

The present disclosure is directed to a method and apparatus for adjusting video composition material, which at least solve the problems of the related art described above, and which may or may not solve any of the problems described above.

According to a first aspect of an embodiment of the present disclosure, a method of adjusting video composition material includes: splitting a selected combined material into at least one material element when an individual editing mode is executed for the combined material in a video editing process; and editing one material element in the at least one material element according to the input of the user.

Optionally, the method further comprises: when an overall editing mode is performed for the combined material during video clipping, the combined material is integrally edited according to a user input.

Optionally, the step of splitting the combined material into at least one material element includes: when an individual editing mode is performed for a selected combined material, switching a video clip from a primary track space page form to a secondary track space page form, splitting a combined graphic element into which the combined material is displayed in a graphic form into at least one graphic element in a picture area of the video clip, and splitting a combined track into which the combined material is displayed in a track form into at least one element track in a track area of the video clip, wherein each of the at least one graphic element corresponds to a different one of the at least one element track.

Optionally, the selected combined material is selected according to a selection of the combined graphic element by a user in the screen area or the combined track in the track area.

Optionally, the step of splitting a combined graphic element into which the combined material is graphically displayed into at least one graphic element in a picture area of the video clip picture comprises: splitting the combined graphic element into the at least one graphic element in the picture area, and displaying an edit box of a selected one of the at least one graphic element.

Optionally, the step of splitting a combined graphic element into which the combined material is graphically displayed into at least one graphic element in a picture area of the video clip picture further comprises: and displaying the highlight mark for the selected one of the graphic elements while displaying the edit box of the selected one of the graphic elements.

Splitting a combined track into which the combined material is displayed in track form into at least one element track in a track region of a video montage further comprises:

scaling an initial timeline of the at least one element track to a maximum view according to an adjustable time of the combined track at the current level.

Optionally, the step of editing one of the at least one material element according to a user input includes: when a click input for a non-overlapping region between the at least one graphic element is received, one of the at least one graphic element corresponding to the non-overlapping region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

Optionally, the step of editing one of the at least one material element according to the user input includes: when a click input for an overlap region between the at least one graphic element is received, one of the at least one graphic element located at a next level of the currently selected graphic element at the overlap region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

Optionally, the step of editing one of the at least one material element according to a user input includes: when a click input for one of the at least one element track is received, the one element track is selected, and when one of the at least one graphic element corresponding to the one element track exists, the one graphic element is selected.

Optionally, the hierarchical relationship between the at least one graphical element corresponds to a hierarchical relationship between respective ones of the at least one element track.

Optionally, the step of editing one of the at least one material element according to a user input includes: adjusting a size, a position, and an angle of a selected one of the at least one graphic element according to a user input without affecting other ones of the at least one graphic element.

Optionally, the step of editing one of the at least one material element according to a user input includes: adjusting a time of the selected one of the at least one element track according to a user input without affecting other of the at least one element track.

Optionally, the step of editing one of the at least one material element according to the user input includes: displaying a message inquiring whether to adjust a time of one element track beyond an adjustable time range of the current hierarchy when one end of the one element track of the at least one element track is dragged to a head time restriction region or a tail time restriction region of the current hierarchy according to a user input and the dragging operation is continued in a dragging direction.

Optionally, when an input for confirming that the time of the one element track is adjusted to be beyond an adjustable time range of a current hierarchy is received, increasing a timeline view range of the at least one element track according to the drag operation by a user and adjusting the adjustable time of the one element track to [0, + ∞ ]; maintaining the timeline view range of the at least one element track and the adjustable time of the one element track when an input is received confirming that the time of the one element track is not adjusted beyond the adjustable time range of the current hierarchy.

Optionally, the step of editing one of the at least one material element according to a user input further includes: and adjusting the hierarchical relation among the at least one material element according to the gesture interaction of the user.

Optionally, the step of adjusting the hierarchical relationship between the at least one material element according to the gesture interaction of the user includes: and determining whether an element track needs to be newly built in the at least one element track according to the staying interval and the staying time of one dragged element track in the at least one element track.

Optionally, the step of determining whether an element track needs to be newly created in the at least one element track includes: when a midline of one of the at least one element track is dragged to an area between two adjacent levels, a top of an uppermost level, or a bottom of a lowermost level and the dwell time is greater than a predetermined threshold, it is determined that a new track level is required to be newly created in the at least one element track to insert the dragged one element track.

Optionally, the step of adjusting the hierarchical relationship between the at least one material element according to the gesture interaction of the user includes: providing feedback to a user of a location at which the one element track was dropped when the drag for the one element track was released, according to the status style and the location of the dragged one of the at least one element track.

Optionally, the method further comprises: when the editing for the one material element is completed: switching a video montage from a secondary track space page form to a primary track space page form, displaying the whole combined track in a selected editing state in the track area, and correspondingly changing the time of the combined track according to the edited element track; and displaying the combined graphic element as a whole in the selected editing state in the screen region, and changing the edit box of the combined graphic element accordingly according to the graphic element for which editing is completed.

According to a second aspect of an embodiment of the present disclosure, an apparatus for adjusting video composition material includes: the splitting unit is configured to split the selected combined material into at least one material element when an individual editing mode is executed for the combined material in the video editing process; an editing display unit configured to edit one of the at least one material element according to a user input.

Optionally, the editing display unit is further configured to: and when an overall editing mode is executed for the combined material in the video editing process, performing overall editing on the combined material according to user input.

Optionally, the splitting unit is configured to split the combined material into at least one material element by: when an individual editing mode is performed for a selected combined material, switching a video clip from a primary track space page form to a secondary track space page form, splitting a combined graphic element into which the combined material is displayed in a graphic form into at least one graphic element in a picture area of the video clip, and splitting a combined track into which the combined material is displayed in a track form into at least one element track in a track area of the video clip, wherein the at least one graphic element corresponds to a different one of the at least one element track.

Optionally, the splitting unit is configured to split the combined graphic element into at least one graphic element into which the combined material is displayed in the graphic form by: splitting the combined graphic element into the at least one graphic element in the picture area, and displaying an edit box of a selected one of the at least one graphic element.

Optionally, the splitting unit is configured to split the combined graphic element of the combined material into at least one graphic element by: and controlling to display the highlight mark for the selected one of the graphic elements while the edit box of the selected one of the graphic elements is displayed.

Optionally, the splitting unit is configured to split the combined track into at least one element track into which the combined material is displayed in track form by: scaling an initial timeline of the at least one element track to a maximum view according to an adjustable time of the combined track at the current level.

Optionally, the editing display unit is configured to edit one of the at least one material element according to a user input by: when a click input to a non-overlapping region between the at least one graphic element is received, one of the at least one graphic element corresponding to the non-overlapping region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

Optionally, the editing display unit is configured to edit one of the at least one material element according to a user input by: when a click input to an overlap region between the at least one graphic element is received, one of the at least one graphic element located at a next level of the currently selected graphic element at the overlap region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

Optionally, the editing display unit is configured to edit one of the at least one material element according to a user input by: when a click input for one of the at least one element track is received, the one element track is selected, and when one of the at least one graphic element corresponding to the one element track exists, the one graphic element is selected.

Optionally, the editing display unit is configured to edit one of the at least one material element according to a user input by: adjusting a size, a position, and an angle of a selected one of the at least one graphic element according to a user input without affecting other ones of the at least one graphic element.

Optionally, the editing display unit is configured to edit one of the at least one material element according to a user input by: adjusting a time of the selected one of the at least one element track according to a user input without affecting other of the at least one element track.

Optionally, the editing display unit is configured to edit one of the at least one material element according to a user input by: displaying a message inquiring whether to adjust a time of one element track beyond an adjustable time range of the current hierarchy when one end of the one element track of the at least one element track is dragged to a head time restriction region or a tail time restriction region of the current hierarchy according to a user input and the dragging operation is continued in a dragging direction.

Optionally, the editing display unit is further configured to: when an input for confirming that the time of the one element track is adjusted to be beyond an adjustable time range of a current hierarchy is received, increasing a time axis view range of the at least one element track according to the drag operation of a user and adjusting the adjustable time of the one element track to [0, + ∞ ]; maintaining the timeline view range of the at least one element track and the adjustable time of the one element track when an input is received confirming that the time of the one element track is not adjusted beyond the adjustable time range of the current hierarchy.

Optionally, the editing display unit is configured to edit one of the at least one material element by: and adjusting the hierarchical relation among the at least one material element according to the gesture interaction of the user.

Optionally, the editing display unit is configured to adjust the hierarchical relationship between the at least one material element by: and determining whether an element track needs to be newly built in the at least one element track according to the staying interval and the staying time of one dragged element track in the at least one element track.

Optionally, the editing display unit is configured to determine whether a new element track is required in the at least one element track by: when a midline of one of the at least one element track is dragged to an area between two adjacent levels, a top of a topmost level, or a bottom of a bottommost level and a dwell time is greater than a predetermined threshold, it is determined that a new track level in the at least one element track is required to insert the dragged one element track.

Optionally, the editing and displaying unit is configured to adjust the hierarchical relationship between the at least one material element by: providing feedback to a user of a location at which the one element track was dropped when the drag for the one element track was released, according to the status style and the location of the dragged one of the at least one element track.

Optionally, when the editing for the one material element is completed, the editing display unit is configured to: switching a video clip picture from a secondary track space page form to a primary track space page form, displaying the whole combined track in a selected editing state in the track area, and correspondingly changing the time of the combined track according to the edited element track; and displaying the combined graphic element as a whole in the selected editing state in the screen area, and correspondingly changing the editing frame of the combined graphic element according to the graphic element which is edited.

According to a fifth aspect of an embodiment of the present disclosure, an electronic device includes: a processor; a memory for storing the processor-executable instructions, wherein the processor is configured to execute the instructions to implement a method of adjusting video composition material according to the present disclosure.

According to a sixth aspect of embodiments of the present disclosure, a computer-readable storage medium, wherein instructions, when executed by a processor of an electronic device, enable an apparatus to perform a method of adjusting video composition material according to the present disclosure.

According to a seventh aspect of an embodiment of the present disclosure, a computer program product comprising computer instructions, wherein the computer instructions, when executed by a processor, implement the method of adjusting video composition material according to the present disclosure.

The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:

the compatibility of independent adjustment and integral adjustment of the mobile terminal is realized by adding a secondary track space page (separating an independent element track and an independent graphic element) to reflect the composition relation of the combined material, so that the editing requirements of users are better met. When the user clicks the "individually adjust" entry in the menu, more advanced custom editing is allowed, enabling individual editing of the size/position/angle/time of element track of the selected graphical element, without affecting other elements within the combined material. Meanwhile, the whole grouped editing and adjusting operation is not affected, different requirement scenes of primary and advanced users are covered, the requirements of the two users are compatible, and the whole/single editing flexibility is supported.

In addition, by splitting and combining the constituent elements of the materials, the user can better understand the constituent relationship of the combined materials, and a primary user can learn the use of the combined materials according to the collocation of the preset materials, so that the editing skill is improved. In addition, the video clip picture is divided into a track area and a picture area, so that the track maximizes the track view according to the adjustable range of the whole material, and the picture highlights the edited combined material, so that a user can perceive the integral composition of all the constituent elements of the combined material, the positioning of the material to be modified is facilitated, the efficient focusing of editing on the mobile terminal is realized, and the detailed experience details are realized, thereby improving the clipping efficiency and the experience of the user.

In addition, the selected graphic elements to be edited are displayed on the uppermost layer of the combined material, and the elements outside the combined material are opaque and masked and can only be referred to but cannot be edited, so that a user can better observe the object being edited, the requirements of the relative relation reference of the elements outside the combined material are met, the efficiency is higher, and the experience is better.

In addition, the track distribution of the track area in the video montage under the form of the secondary track space page can map the real hierarchical relationship, and the hierarchical relationship is more efficiently and intuitively adjusted through gesture interaction, so that the hierarchical relationship of the constituent elements in the combination is more naturally and efficiently adjusted. In addition, the default user may adjust within the current tier limits, thereby maintaining flexibility of adjustment under mobile-side limits. When the fact that the intention of the user needs to exceed the adjustable time of the original combined material is judged, the user is inquired whether the adjustable time of the original combined material exceeds the adjustable time of the original combined material, so that the fact that single time adjustment is allowed to be prior to the whole hierarchy is achieved, various users can conveniently edit scenes, and meanwhile failure activity is avoided.

The method has the advantages that the different state styles and positions of the dragging track are used for giving preposed feedback of the user after the user releases the drop position, and whether the user needs to newly build a track level in the middle of the track is judged according to the position interval and the retention time of the material track dragged by the user, so that the purpose that the element level relation in the combined material is adjusted through the user gesture is achieved, the operation is more efficient, and the adjusting process is more visual.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

Fig. 1 is a flowchart illustrating a method of adjusting video composition material according to an exemplary embodiment of the present disclosure.

Fig. 2 to 9 are exemplary diagrams illustrating adjusting a video composition material according to an exemplary embodiment of the present disclosure.

Fig. 10 is a block diagram illustrating an apparatus for adjusting video composition material according to an exemplary embodiment of the present disclosure.

Fig. 11 is a block diagram illustrating an electronic device according to an exemplary embodiment of the present disclosure.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in other sequences than those illustrated or described herein. The embodiments described in the following examples do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

In this case, the phrase "at least one of the plurality of items" in the present disclosure means that the three parallel cases including "any one of the plurality of items", "a combination of any plurality of the plurality of items", and "the entirety of the plurality of items" are included. For example, "include at least one of a and B" includes the following three cases in parallel: (1) comprises A; (2) comprises B; and (3) comprises A and B. For another example, "at least one of the first step and the second step is performed", which means that the following three cases are juxtaposed: (1) executing the step one; (2) executing the step two; and (3) executing the step one and the step two.

As mentioned in the background of the present disclosure, in the related art, the hierarchical relationship between the individual materials in the combined material cannot be adjusted for the existing video editing-type scheme of the mobile terminal, and when the user wants to adjust the size/position/appearance time relationship between the individual materials in the combined material, only one of the individual adjustment scheme and the overall adjustment scheme can be selected, and the size/position/time of the partial constituent elements cannot be individually fine-tuned to adapt to the clipping requirement on the basis of maintaining the overall group relationship; in addition, when a user wants to adjust the hierarchy (not the top layer or the bottom layer) between the materials in the combination, aiming at the condition that the existing video editing class scheme of the mobile terminal has more time overlapping elements, the hierarchy can be adjusted to the middle hierarchy by clicking for multiple times, and the user needs to observe the picture effect to distinguish whether the picture effect is in accordance with the expectation; in addition, research finds that when the user wants to modify the material, the user can more directly respond to clicking selection in the picture, however, the existing video editing scheme aiming at the mobile terminal cannot enable the user to select the material through intuitive picture clicking, and only can select the uppermost element in the overlapping area. In addition, when elements are edited individually, the elements may be disturbed by other materials (the edited single material is distributed hierarchically to the bottom and is more covered by the materials outside the combination). Therefore, the present disclosure provides a method and an apparatus for adjusting a video combination material, so as to greatly improve the convenience of editing a video by a mobile terminal user. This will be described in detail with reference to fig. 1 to 10.

Before describing embodiments of the present disclosure in detail, some terms or abbreviations that may be involved with the embodiments of the present disclosure are described:

material combination: the combined material has the effects of helping primary users to quickly use and match the combined material and reducing the production cost.

Bottom view: the large-area vector graphics in the text materials usually wrap the text, so that the visual effect of the text is enhanced, and the expression is assisted.

And (3) hierarchy: in the video clip, the covering relation of the display material is indicated, the material of the upper layer is overlapped with the material of the lower layer, and the upper layer material shields the material of the lower layer.

Fig. 1 shows a flowchart of a method of adjusting video composition material according to an exemplary embodiment of the present disclosure. The method for adjusting the video composition material shown in fig. 1 may be performed at a network side connected to the electronic device or locally at the electronic device.

The electronic device may be any electronic device capable of performing human-computer interaction and having a function of playing or editing video, for example, a user may perform human-computer interaction through software such as video playing and editing software installed in a mobile terminal device, but the application is not limited thereto.

In an example embodiment of the present disclosure, the electronic device may include, for example, but not limited to, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a camera, a wearable device, and the like. According to the embodiments of the present disclosure, the electronic device is not limited to the above.

Referring to fig. 1, when an individual editing mode is performed for a selected combined material during a video clip, the combined material is split into at least one material element at step S110.

In particular, in the present disclosure, the video montage may be displayed in a primary track space page form or a secondary track space page form, as shown in fig. 2, where (a) of fig. 2 shows the video montage in the primary track space page form and (b) of fig. 2 shows the video montage in the secondary track space page form. Further, the video clip in the primary track space page form or the secondary track space page form may be divided into two regions, as shown in (a) and (b) of fig. 2, an upper region of the video clip is a picture region 210 of the video clip, and a lower region of the video clip is a track region 220 of the video clip, wherein the combined material may be displayed in the video clip in two forms, wherein the combined material may be displayed in the picture region 210 as a combined graphic element in a graphic form and displayed superimposed on the video, and may be displayed in the track region 220 as a combined track in a track form. The combined graphic element shown in (a) of fig. 2 may include a main text (lyrical caption), a base map, a sub text (The lyrics subtitles) as shown in (b) of fig. 2, and The combined track (The combined lyrical caption "as shown in The track area in (a) of fig. 2) may include at least one element track (three tracks as shown in The track area in (b) of fig. 2). Further, an audio effect is not included in the combined material shown in (a) and (b) of fig. 2, and if the combined material includes an audio effect, an audio track is also included in at least one element track included in the combined track, but since no graphic element corresponding thereto exists for the audio effect, the number of graphic elements included in the combined graphic element may be smaller than the number of element tracks included in the combined track. In the video clipping process, when a user clicks a combined graphic element of the combined material in the picture area, the combined material is selected, and a combined track corresponding to the combined graphic element of the combined material in the track area is also selected. Likewise, when a user clicks on a combined track of combined material in the track region, the combined track may be selected, while a combined graphical element of the combined material in the screen region corresponding to the combined track is also selected. In other words, the selected combined material may be selected according to a selection of a combined graphic element of the combined material in the screen region or a selection of a combined track of the combined material corresponding to the combined graphic element in the track region by the user. Although the above description has been made by taking the combined material as an example, the non-combined material may be selected in the above manner.

In addition, the present application may perform an overall editing mode or an individual editing mode for the combined material during the video editing process, where the overall editing mode indicates that the overall editing is performed for the combined material, as shown in fig. 2 (a), and the user may directly adjust the position, size, angle, and the like of the combined graphic element in the screen area, and may also adjust the time of the combined track in the track area. That is, when the overall editing mode is performed for the combined material during video clipping, the combined material can be integrally edited according to a user input.

In addition, when the individual editing mode is performed with respect to the selected combined material, the combined material may be split into at least one material element. Specifically, the step of splitting the combined material into at least one material element includes: when an individual editing mode is performed for a selected combined material, switching a video clip from a primary track space page form to a secondary track space page form, splitting a combined graphic element into which the combined material is displayed in a graphic form into at least one graphic element in a picture area of the video clip, and splitting a combined track into which the combined material is displayed in a track form into at least one element track in a track area of the video clip, wherein each of the at least one graphic element corresponds to a different one of the at least one element track.

For example, when The user clicks The "individual adjustment" option as shown in (a) of fig. 2, it indicates that The individual editing mode is performed for The selected combined material, at which time The combined material is split into at least one material element, that is, a combined graphic element into which The combined material is graphically displayed is split into three graphic elements, that is, a main text (lyric caption), a base chart, a sub-text (The lyrics subtitle), and an editing box of The selected graphic element (for example, the uppermost main text) of The three graphic elements is displayed, as shown in The screen area 210 in (b) of fig. 2. That is, the step of splitting the combined graphic element into which the combined material is graphically displayed into at least one graphic element in the screen area 210 of the video clip may include: splitting the combined graphic element into the at least one graphic element in the picture area, and displaying an edit box of a selected one of the at least one graphic element. This enables the user to individually fine-tune the size/position/time/hierarchy of the partial constituent elements to the clip while maintaining the overall set of relationships of the combined material.

Further, the step of splitting a combined graphic element into which the combined material is graphically displayed into at least one graphic element in a picture area of the video clip picture may further include: and displaying the highlight mark for the selected one of the graphic elements while displaying the edit box of the selected one of the graphic elements. For example, in order to make it easier for the user to distinguish the selected graphic elements, the tab shown in fig. 3 (e.g., the bubble (1) in fig. 3) may also be used to distinguish the selected graphic elements, and at the same time, the user may be provided with a fine adjustment effect for the tab through the adjustment bar 310 in the pop-up window.

Further, the splitting of the combined track into which the combined material is displayed in a track form into at least one element track in a track area of the video clip may include: scaling an initial timeline of the at least one element track to a maximum view according to an adjustable time of the combined track at the current level. Specifically, the section 230 between the two white dotted lines in fig. 2 (a) is a maximum time section that the level of the combined track can be adjusted, which is assumed to be X-Y, when the video clip is switched to the secondary track space page form, the initial time axis of the at least one element track is scaled to fit the maximum section X-Y that the currently combined material can adjust, and the time position of the default individually adjusted material track cannot exceed the maximum section X-Y that the currently combined material can adjust. This enables the user to have an overall composition perception of all the constituent elements of the combined material, facilitating the positioning of the material that the user wants to modify.

Returning to fig. 1, in step S120, one of the at least one material element is edited according to a user input.

Specifically, the editing of one of the at least one material element according to the user input may include: when a click input for a non-overlapping region between the at least one graphic element is received, one of the at least one graphic element corresponding to the non-overlapping region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

For example, as shown in (a) of fig. 4, at this time, the combined graphic element in The screen region has been split into three graphic elements, i.e., a main text (lyric subtitles) partially overlapping with The underlying map, a sub text (The lyrics subtitles) completely overlapping with The underlying map, but not overlapping with The sub text (The lyrics subtitles). If the user clicks a non-overlapping area between the main text (lyric caption) and the base map at this time, a graphic element corresponding to the non-overlapping area in the main text (lyric caption) and the base map is selected, for example, when the user clicks a non-overlapping area belonging to the base map between the main text (lyric caption) and the base map, the base map is selected, as shown in the screen area 210 in (b) of fig. 4, and at the same time, an element track corresponding to the base map is also selected, as shown in the lowermost selected element track corresponding to the base map in the track area 220 in (b) of fig. 4.

Further, the editing of one of the at least one material element according to user input may include: when a click input to an overlap region between the at least one graphic element is received, one of the at least one graphic element located at a next level of the currently selected graphic element at the overlap region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

Specifically, when the combined graphic element is split into at least one graphic element, the uppermost graphic element, such as the main text (lyric caption) shown in fig. 4 (a), is selected by default. In this case, if The user clicks an overlap region between The main text (lyric subtitle) and The base map, it is switched to a graphic element, i.e., the base map, positioned at a next level of The main text (lyric subtitle) in The overlap region, instead of The secondary text (The lyrics subtitles), and although The secondary text (The lyrics subtitles) is positioned at an upper level of The base map as a whole, the secondary text (The lyrics subtitles) is not positioned at The overlap region between The main text (lyric subtitle) and The base map, and thus, in The case where The main text (lyric subtitle) is selected, the user clicks The overlap region between The main text (lyric subtitle) and The base map once, it is switched to The base map. Meanwhile, one of the three element tracks corresponding to the base map is automatically selected. In addition, the user can switch to the next level by clicking the overlapping area for multiple times, if the selected level is the lowest level, the selected level is switched back to the uppermost graphical element of the overlapping area when the overlapping area is clicked again, and in the process, the track element corresponding to the selected graphical element in the track area is also selected correspondingly, so that the user can know the corresponding relation between the currently selected track element and the graphical element and the level relation between the graphical elements more intuitively, and the user can conveniently and intuitively select the non-top-level object in the picture. In addition to the switching method described above, it is also possible to display a scroll wheel icon in a screen area or a track area, and then switch between the levels of the overlapping areas according to a scroll operation of the scroll wheel icon by the user. Alternatively, when the overlap area is clicked as shown in (a) of fig. 5, a thumbnail of a graphic element corresponding to the overlap area may be displayed near the overlap area in (b) of fig. 5, and if the user clicks a thumbnail of a certain graphic element (e.g., a thumbnail of a bottom drawing) in (b) of fig. 5, a graphic element corresponding to the thumbnail in the overlap area may be selected as shown in (c) of fig. 5, and accordingly, an element track corresponding to the graphic element in a track area may also be selected.

Further, the step of editing one of the at least one material element according to a user input may comprise: when a click input for one of the at least one element track is received, the one element track is selected, and when one of the at least one graphic element corresponding to the one element track exists, the one graphic element is selected.

Specifically, when an element track corresponding to the base map as shown in the track area 220 in (a) of fig. 4 is clicked, the element track is directly selected, and accordingly, the base map corresponding to the element track in the screen area 210 is automatically selected as shown in (b) of fig. 4. Further, if the combined material includes an audio effect, a graphic element corresponding to the audio effect does not exist in the screen region 210, but an element track corresponding to the audio effect exists in the track region 220, and when the element track corresponding to the audio effect is selected, the element corresponding to the element track is not displayed in the screen region 210, but the audio effect can be played in the form of audio.

In addition, the hierarchical relationship between at least one graphic element in the screen region 210 corresponds to the hierarchical relationship between respective ones of at least one element track in the track region. Specifically, as shown in fig. 4 (a), the hierarchical relationship between The main text (lyric caption), the sub-text (The lyrics subtitles), and The base map in The screen region 210 corresponds to The hierarchical relationship between The element track corresponding to The main text, the element track corresponding to The sub-text, and The element track corresponding to The base map in The track region 220, respectively, for example, if The hierarchical levels of The main text (lyric caption), the sub-text (The lyrics subtitles), and The base map in The screen region are 1 st level, 2 nd level, and 3 rd level, respectively, then The element track corresponding to The main text, the element track corresponding to The sub-text, and The element track corresponding to The base map are also 1 st level, 2 nd level, and 3 rd level, respectively.

Further, the editing of one of the at least one material element according to user input may include: adjusting a size, a position, and an angle of a selected one of the at least one graphic element according to a user input without affecting other ones of the at least one graphic element.

In particular, as shown in (b) of fig. 4, when a graphic element (e.g., main text (lyric caption)) in the screen area 210 is selected, other graphic elements can be used only as a reference and are not editable, the selected graphic element is displayed at the uppermost layer of the screen area 210, and the user can adjust the size, position and angle of the graphic element without any influence on the other graphic elements, thereby facilitating the user to adjust in focus during individual editing.

Further, the step of editing one of the at least one material element according to a user input may comprise: adjusting a time of the selected one of the at least one element track according to a user input without affecting other of the at least one element track.

In particular, as shown in (b) of fig. 4, when an element track (e.g., an element track corresponding to a base map) in the track area 220 is selected, a user can adjust the time of the element track without any influence on other element tracks, thereby facilitating the user to adjust in focus in a separate editing process.

The step of editing one of the at least one material element according to user input comprises: displaying a message inquiring whether to adjust a time of one element track beyond an adjustable time range of the current hierarchy when one end of the one element track of the at least one element track is dragged to a head time restriction region or a tail time restriction region of the current hierarchy according to a user input and the dragging operation is continued in a dragging direction.

Specifically, as shown in (a) of fig. 6, when an element track corresponding to the base map in the track area 220 is selected, if the user touches the rightmost end of the element track and drags it to the right, the time of the element track may be long, and when the rightmost end of the element track is dragged to the tail time restriction area on the right side of the current hierarchy and continues dragging it to the right in the dragging direction, an inquiry window may pop up to inquire whether to adjust the time of the element track beyond the adjustable time range of the current hierarchy of the combined element map, as shown in (b) of fig. 6. Specifically, assuming that there are tracks adjacent to the combined material in the same hierarchy, and assuming that the time range of the previous adjacent track is (a, b) and the time range of the next adjacent track is (x, y), the default time adjustment range of the user at the current hierarchy during the secondary track editing is: (b, x), in this case, if there is no other component track on the left side of the same hierarchy, b =0, and if there is no other component track on the right side of the same hierarchy, x = ∞. In this case, when an input for confirming that the time of the element track is adjusted to be beyond the adjustable time range of the current hierarchy is received, the time axis view range of the at least one element track (i.e., three element tracks in fig. 6) is increased according to the above-described drag operation by the user, and the adjustable time of the element track (i.e., the element track corresponding to the base map) is adjusted to [0, + ∞ ], as shown in (c) of fig. 6. When an input is received confirming that the time of the element track is not adjusted beyond the adjustable time range of the current hierarchy, the timeline view range of the at least one element track (i.e., the three element tracks in fig. 6) and the adjustable time of the one element track are maintained.

In addition, the step of editing one of the at least one material element according to the user input may further include: and adjusting the hierarchical relationship among the at least one material element according to the gesture interaction of the user. Where the user's gesture interaction may be the user touching and dragging a track element in a track area in the video montage, although the invention is not limited thereto.

In particular, the step of adjusting the hierarchical relationship between the at least one material element according to the gesture interaction of the user may comprise: and determining whether an element track needs to be newly built in the at least one element track according to the retention interval and the retention time of one dragged element track in the at least one element track. Wherein the dwell interval may be the area between two adjacent levels, the top of the uppermost level or the bottom of the lowermost level. As shown in fig. 7, an area between two adjacent levels may be an area between the first level 710 and the second level 720 or an area between the second level 720 and the third level 730, a top of an uppermost level may be a top of the first level 710, and a lowermost level may be a bottom of the third level 730.

Specifically, the step of determining whether a new element track is required to be created in the at least one element track may include: when a midline of one of the at least one element track is dragged to an area between two adjacent levels, a top of an uppermost level, or a bottom of a lowermost level and the dwell time is greater than a predetermined threshold, it is determined that a new track level is required to be newly created in the at least one element track to insert the dragged one element track.

For example, as shown in fig. 7, when a user touches and drags a selected one of the element tracks such that a center line of the element track is dragged to an area between two adjacent hierarchies (e.g., the first hierarchy 710 and the second hierarchy 720) and stays in the area for a time greater than a predetermined threshold, a track hierarchy is newly created between the two adjacent hierarchies, and the dragged element track is inserted into the newly created track hierarchy. If the centerline of the element track is dragged to a top region of the uppermost level (e.g., second level 710) and stays there for more than a predetermined threshold, a track level is newly created above the uppermost level, the newly created track level becomes the uppermost level, the other levels are sequentially lowered by one level, and the dragged element track is inserted into the newly created track level. If the midline of the element track is dragged to the bottom region of the lowest tier (e.g., third tier 730) and stays there for more than a predetermined threshold, a track tier is newly created below the lowest tier, the newly created track tier becomes the lowest tier, and the dragged element track is inserted into the newly created track tier. Therefore, the hierarchical relationship among the constituent elements can be adjusted more flexibly, efficiently and intuitively.

Further, the step of adjusting the hierarchical relationship between the at least one material element according to the gesture interaction of the user may comprise: providing feedback to a user of a location at which the one element track was dropped when the drag for the one element track was released, according to the status style and the location of the dragged one of the at least one element track. For example, fig. 8 shows the status style, indication role, trigger timing, characteristics of an element track for the status of the element track, and fig. 9 shows an example when a user touches and drags a track element to change the hierarchical relationship and to create a hierarchical track. Specifically, three states "dropped state (unselected)", "drag activation state", and "unplaceable state" are collectively included in fig. 8, and these three states may be represented in different color styles, respectively. The style corresponding to "placed state (unselected)" may be used to represent the element track duration, the position in the time dimension, and the distribution position of the element track visible area. The style corresponding to the "drag activation state" may be used to indicate that the current element track is activated, that adjustment of time and distribution position is possible, and that the current position represents a position to be dropped when the finger releases the touch at this time, and further, the element track represented by the style is defined only between the respective element tracks when moved. The style corresponding to the "no-placeable state" may be used to indicate that the current track element cannot be placed at the current position. In addition, the table shown in FIG. 8 also shows the timing and characteristics at which the various element tracks of "dropped state (unselected)", "drag-active state", and "not-dropped state" are triggered.

An example of adjusting the hierarchical relationship between the at least one material element according to the user's gesture interaction is described below with reference to fig. 8 and 9. If the user holds a certain track of elements in the column 1 image in fig. 9, the track element changes from the "dropped state" in fig. 8 to the "drag activation state" and the user can be prompted of the state change by vibration, if the user drags the center line of the one track element to the area between the first level (i.e., the top level) and the second level as shown in the columns 1 to 2 in fig. 9 and stays there for a time greater than a predetermined threshold, when the user releases the dragging of the one track element, a new track level will be established between the first level and the second level and the one track element will be inserted into the newly created track level as shown in the lower image in the column 2 image in fig. 9. When the user does not make the center line of the one track element stay at the area between the first hierarchy and the second hierarchy as shown in columns 2 to 3 or the stay time is less than or equal to the predetermined threshold value and continues to drag the one track element to the first hierarchy, if the user makes the center line of the one track element stay at the top of the first hierarchy (at this time, the state of the one track element changes from the "drag activated state" to the "unplacable state") and the stay time is greater than the predetermined threshold value, when the user releases the drag of the one track element, a new track hierarchy is newly created above the first hierarchy and the one track element is inserted into the newly created track hierarchy, as shown in the lower image in the 3 rd column image in fig. 9. When the user does not make the center line of the one track element stay at the area between the first hierarchy and the second hierarchy as shown in columns 3 to 4 or the stay time is less than or equal to the predetermined threshold value and continues to drag the one track element toward the lowermost hierarchy, if the user makes the center line of the one track element stay at the bottom of the lowermost hierarchy (at this time, the state of the one track element changes from the "drag activated state" to the "unplacable state") and the stay time is greater than the predetermined threshold value, when the user releases the drag of the one track element, a new track hierarchy is newly created above the lowermost hierarchy and the one track element is inserted into the newly created track hierarchy, as shown by the lower image in the column 4 image in fig. 9. In the above manner, the user can know the position where the currently dragged element track is placed when the touch is released according to the corresponding front feedback.

Further, the method may further include: when the editing for the one material element is completed: switching the video clip picture from a secondary track space page form to a primary track space page form, displaying the whole combined track in a track area as a selected editing state, and correspondingly changing the time of the combined track according to the edited element track; and displaying the combined graphic element in the selected editing state in the picture area in a whole manner, and correspondingly changing the editing frame of the combined graphic element according to the graphic element which is edited.

Specifically, as shown in (d) in fig. 6, if editing has been previously completed for the element track corresponding to the base map, the video clip is switched from the secondary track space page form to the primary track space page form, the combined track is displayed in its entirety in the selected editing state in the track area 220 under the primary track space page form, and the time of the combined track is changed accordingly according to the element track for which editing is completed, as shown in the track area 220 of (d) in fig. 6. If the editing has been previously completed with respect to the base map, the combined graphic element is displayed in its entirety in the selected editing state in the screen area 210, and the editing frame of the combined graphic element is changed accordingly according to the graphic element for which the editing has been completed, as shown in the screen area 210 of (d) in fig. 6.

As shown in fig. 10, the apparatus 1000 includes a splitting unit 1010 and an editing display unit 1020. The splitting unit 1010 is configured to split the selected combined material into at least one material element when an individual editing mode is performed for the combined material during video clipping. The editing display unit 1020 is configured to edit one of the at least one material element according to a user input.

The splitting unit 1010 is configured to split the combined material into at least one material element by: when an individual editing mode is performed for a selected combined material, switching a video clip from a primary track space page form to a secondary track space page form, splitting a combined graphic element into which the combined material is displayed in a graphic form into at least one graphic element in a picture area of the video clip, and splitting a combined track into which the combined material is displayed in a track form into at least one element track in a track area of the video clip, wherein the at least one graphic element corresponds to a different one of the at least one element track. The selected combined material is selected in accordance with a user selection of the combined graphic element in the screen region or the combined track in the track region.

The editing display unit 1020 is further configured to perform overall editing on the combined material according to a user input when an overall editing mode is performed for the combined material during video clipping.

The splitting unit 1010 is configured to split a combined graphical element into which the combined material is displayed in graphical form into at least one graphical element by: splitting the combined graphic element into the at least one graphic element in the picture area, and displaying an edit box of a selected one of the at least one graphic element.

The splitting unit 1010 is configured to split the combined graphic element into which the combined material is graphically displayed into at least one graphic element by: and controlling to display the highlight mark for the selected one of the graphic elements while the edit box of the selected one of the graphic elements is displayed.

The splitting unit 1010 is configured to split the combined track into which the combined material is displayed in track form into at least one element track by: scaling an initial timeline of the at least one element track to a maximum view according to an adjustable time of the combined track at the current level.

The editing display unit 1020 is configured to edit one of the at least one material element according to a user input by: when a click input for a non-overlapping region between the at least one graphic element is received, one of the at least one graphic element corresponding to the non-overlapping region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

The editing display unit 1020 is configured to edit one of the at least one material element according to a user input by: when a click input to an overlap region between the at least one graphic element is received, one of the at least one graphic element located at a next level of the currently selected graphic element at the overlap region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

The editing display unit 1020 is configured to edit one of the at least one material element according to a user input by: when a click input for one of the at least one element track is received, the one element track is selected, and when one of the at least one graphic element corresponding to the one element track exists, the one graphic element is selected.

A hierarchical relationship between the at least one graphic element corresponds to a hierarchical relationship between respective ones of the at least one element track.

The editing display unit 1020 is configured to edit one of the at least one material element according to a user input by: adjusting a size, a position, and an angle of a selected one of the at least one graphic element according to a user input without affecting other ones of the at least one graphic element.

The editing display unit 1020 is configured to edit one of the at least one material element according to a user input by: adjusting a time of the selected one of the at least one element track according to a user input without affecting other of the at least one element track.

The editing display unit 1020 is configured to edit one of the at least one material element according to a user input by: displaying a message for inquiring whether to adjust a time of one element track beyond an adjustable time range of a current hierarchy when one end of the one element track of the at least one element track is dragged to a head time restriction area or a tail time restriction area of the current hierarchy according to a user input and a dragging operation is continued in a dragging direction.

The editing display unit is further configured to: when an input for confirming that the time of the one element track is adjusted to be beyond an adjustable time range of a current hierarchy is received, increasing a time axis view range of the at least one element track according to the drag operation of a user and adjusting the adjustable time of the one element track to [0, + ∞ ]; maintaining the timeline view range of the at least one element track and the adjustable time of the one element track when an input is received confirming that the time of the one element track is not adjusted beyond the adjustable time range of the current hierarchy.

The editing display unit 1020 is configured to edit one of the at least one material element by: and adjusting the hierarchical relation among the at least one material element according to the gesture interaction of the user.

The editing display unit 1020 is configured to adjust the hierarchical relationship between the at least one material element by: and determining whether an element track needs to be newly built in the at least one element track according to the retention interval and the retention time of one dragged element track in the at least one element track.

The editing display unit 1020 is configured to determine whether a new element track is required in the at least one element track by: when a midline of one of the at least one element track is dragged to an area between two adjacent levels, a top of an uppermost level, or a bottom of a lowermost level and the dwell time is greater than a predetermined threshold, it is determined that a new track level is required to be newly created in the at least one element track to insert the dragged one element track.

The editing and displaying unit 1020 is configured to adjust the hierarchical relationship between the at least one material element by: providing feedback to a user of a location at which the one element track was dropped when the drag for the one element track was released, according to the status style and the location of the dragged one of the at least one element track.

When the editing for the one material element is completed, the editing display unit 920 is configured to: switching the video clip picture from a secondary track space page form to a primary track space page form, displaying the combined track as a whole in a track area in a selected editing state, and correspondingly changing the time of the combined track according to the edited element track; and displaying the combined graphic element in the selected editing state in the picture area in a whole manner, and correspondingly changing the editing frame of the combined graphic element according to the graphic element which is edited.

Since this has already been described in detail above with reference to fig. 1 to 9, it is not described here in detail.

According to an embodiment of the present disclosure, an electronic device may be provided. Fig. 11 is a block diagram of an electronic device 1100 according to an embodiment of the disclosure, which electronic device 1000 may include a memory 1102 and a processor 1101, the memory 1102 storing instructions executable by the processor 1101, the processor 1101 configured to execute the instructions to implement a method of adjusting video combined material according to the disclosure.

The processor 1101 may include a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a programmable logic device, a special purpose processor system, a microcontroller, or a microprocessor. By way of example, and not limitation, processor 1101 may also include an analog processor, a digital processor, a microprocessor, a multi-core processor, a processor array, a network processor, or the like.

The memory 1102, which is one type of storage medium, may include an operating system (e.g., a MAC operating system), a data storage module, a network communication module, a user interface module, a video editing program, a model training program, and a database.

The memory 1102 may be integrated with the processor 1101, for example, a RAM or flash memory may be disposed within an integrated circuit microprocessor or the like. Further, memory 1102 may comprise a stand-alone device, such as an external disk drive, storage array, or other storage device usable by any database system. The memory 1102 and the processor 1101 may be operatively coupled or may communicate with each other, such as through I/O ports, network connections, etc., so that the processor 1101 can read files stored in the memory 1102.

In addition, the electronic device 1100 may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, mouse, touch input device, etc.). All components of electronic device 110 may be connected to each other via a bus and/or a network.

As an example, the electronic device 1100 may be a PC computer, tablet device, personal digital assistant, smart phone, or other device capable of executing the set of instructions. The electronic device 1000 need not be a single electronic device, but can be any collection of devices or circuits that can execute the above instructions (or sets of instructions) individually or in combination. The electronic device 1100 may also be part of an integrated control system or system manager, or may be configured as a portable electronic device that interfaces with local or remote (e.g., via wireless transmission).

Those skilled in the art will appreciate that the configuration shown in fig. 11 is not intended to be limiting and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.

According to an embodiment of the present disclosure, there may also be provided a computer-readable storage medium storing instructions that, when executed by a processor of an electronic device, enable the electronic device to perform a method of adjusting video combined material according to the present disclosure. Examples of computer-readable storage media herein include: read-only memory (ROM), random-access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), flash memory, non-volatile memory, CD-ROM, CD-R, CD + R, CD-RW, CD + RW, DVD-ROM, DVD-R, DVD-RW, DVD + RW, DVD-RAM, BD-ROM, BD-R LTH, BD-RE, blu-ray or optical disk memory, hard Disk Drive (HDD), solid State Disk (SSD), card memory (such as a multimedia card, a Secure Digital (SD) card or an extreme digital (XD) card), magnetic tape, a floppy disk, a magneto-optical data storage device, an optical data storage device, a hard disk, a solid state disk, and any other device configured to store and provide computer programs and any associated data, data files and data structures in a non-transitory manner to a computer processor or computer such that the computer programs and any associated data processors are executed or computer programs. The computer program in the computer-readable storage medium described above can be run in an environment deployed in a computer apparatus, such as a client, a host, a proxy device, a server, and the like, and further, in one example, the computer program and any associated data, data files, and data structures are distributed across a networked computer system such that the computer program and any associated data, data files, and data structures are stored, accessed, and executed in a distributed fashion by one or more processors or computers.

In an embodiment according to the present disclosure, there may also be provided a computer program product comprising computer instructions which, when executed by a processor, implement the method of adjusting video composition material according to the present disclosure.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for adjusting video composition material, comprising:

splitting a selected combined material into at least one material element when an individual editing mode is executed for the combined material in a video editing process;

editing one of the at least one material element according to a user input,

the step of splitting the combined material into at least one material element comprises the following steps:

when an individual editing mode is performed for a selected combined material, switching a video clip from a primary track space page form to a secondary track space page form, splitting a combined graphic element into which the combined material is displayed in a graphic form into at least one graphic element in a picture area of the video clip, and splitting a combined track into which the combined material is displayed in a track form into at least one element track in a track area of the video clip, wherein each of the at least one graphic element corresponds to a different one of the at least one element track.

2. The method of claim 1, further comprising: when an overall editing mode is performed for the combined material during video editing, the combined material is integrally edited according to a user input.

3. The method of claim 1, wherein the selected combined material is selected based on a user selection of the combined graphical element in the screen area or the combined track in the track area.

4. The method of claim 1, wherein the step of splitting a combined graphic element into which the combined material is graphically displayed into at least one graphic element in a picture area of a video montage comprises:

splitting the combined graphic element into the at least one graphic element in the picture area, and displaying an edit box of a selected one of the at least one graphic element.

5. The method of claim 4, wherein the step of splitting into at least one graphical element in a picture area of a video clip a combined graphical element into which the combined material is graphically displayed further comprises:

and displaying the highlight mark for the selected one of the graphic elements while displaying the edit box of the selected one of the graphic elements.

6. The method of claim 1, wherein splitting a combined track into which the combined material is displayed in track form into at least one element track in a track area of a video clip comprises:

7. The method of claim 1, wherein the step of editing one of the at least one material element in accordance with user input comprises: when a click input for a non-overlapping region between the at least one graphic element is received, one of the at least one graphic element corresponding to the non-overlapping region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

8. The method of claim 1, wherein the step of editing one of the at least one material element in accordance with user input comprises: when a click input for an overlap region between the at least one graphic element is received, one of the at least one graphic element located at a next level of the currently selected graphic element at the overlap region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

9. The method of claim 1, wherein the step of editing one of the at least one material element in accordance with user input comprises: when a click input for one of the at least one element track is received, the one element track is selected, and when one of the at least one graphic element corresponding to the one element track exists, the one graphic element is selected.

10. The method of claim 1, wherein a hierarchical relationship between the at least one graphic element corresponds to a hierarchical relationship between respective ones of the at least one element track.

11. The method of claim 1, wherein the step of editing one of the at least one material element in accordance with user input comprises: adjusting a size, a position, and an angle of a selected one of the at least one graphic element according to a user input without affecting other ones of the at least one graphic element.

12. The method of claim 1, wherein the step of editing one of the at least one material element in accordance with user input comprises: adjusting a time of the selected one of the at least one element track according to a user input without affecting other of the at least one element track.

13. The method of claim 6, wherein the step of editing one of the at least one material element in accordance with user input comprises: displaying a message inquiring whether to adjust a time of one element track beyond an adjustable time range of the current hierarchy when one end of the one element track of the at least one element track is dragged to a head time restriction region or a tail time restriction region of the current hierarchy according to a user input and the dragging operation is continued in a dragging direction.

14. The method of claim 13,

when an input for confirming that the time of the one element track is adjusted to be beyond an adjustable time range of a current hierarchy is received, increasing a time axis view range of the at least one element track according to the drag operation of a user and adjusting the adjustable time of the one element track to [0, + ∞ ];

maintaining the timeline view range of the at least one element track and the adjustable time of the one element track when an input is received confirming that the time of the one element track is not adjusted beyond the adjustable time range of the current hierarchy.

15. The method of claim 1, wherein the step of editing one of the at least one material element in accordance with user input further comprises:

and adjusting the hierarchical relation among the at least one material element according to the gesture interaction of the user.

16. The method as recited in claim 15, wherein the step of adjusting the hierarchical relationship between the at least one material element in accordance with the user's gesture interaction comprises:

and determining whether an element track needs to be newly built in the at least one element track according to the retention interval and the retention time of one dragged element track in the at least one element track.

17. The method of claim 16, wherein the step of determining whether a new element track is required in the at least one element track comprises:

when a midline of one of the at least one element track is dragged to an area between two adjacent levels, a top of an uppermost level, or a bottom of a lowermost level and the dwell time is greater than a predetermined threshold, it is determined that a new track level is required to be newly created in the at least one element track to insert the dragged one element track.

18. The method as recited in claim 16, wherein the step of adjusting the hierarchical relationship between the at least one material element in accordance with the user's gesture interaction comprises:

providing feedback to a user of a location at which the one element track was dropped when the drag for the one element track was released, according to the status style and the location of the dragged one of the at least one element track.

19. The method of claim 1, further comprising: when the editing for the one material element is completed:

switching the video montage from a secondary track space page form to a primary track space page form;

displaying the combined track as a whole in a selected editing state in the track area, and correspondingly changing the time of the combined track according to the edited element track; and is

And displaying the combined graphic element as a whole in the selected editing state in the picture area, and correspondingly changing the editing frame of the combined graphic element according to the edited graphic element.

20. An apparatus for adjusting video composition material, comprising:

the splitting unit is configured to split the selected combined material into at least one material element when an individual editing mode is executed for the combined material in the video editing process;

an editing display unit configured to edit one of the at least one material element according to a user input,

wherein the splitting unit is configured to split the combined material into at least one material element by: when an individual editing mode is performed for a selected combined material, switching a video clip from a primary track space page form to a secondary track space page form, splitting a combined graphic element into which the combined material is displayed in a graphic form into at least one graphic element in a picture area of the video clip, and splitting a combined track into which the combined material is displayed in a track form into at least one element track in a track area of the video clip, wherein the at least one graphic element corresponds to a different one of the at least one element track.

21. The apparatus of claim 20, wherein the editing display unit is further configured to: and when an overall editing mode is executed for the combined material in the video editing process, performing overall editing on the combined material according to user input.

22. The apparatus of claim 20, wherein the selected combined material is selected based on a user selection of the combined graphical element in the screen area or the combined track in the track area.

23. The apparatus of claim 20, wherein the splitting unit is configured to split a combined graphical element into which the combined material is graphically displayed into at least one graphical element by:

24. The apparatus of claim 20, wherein the splitting unit is configured to split a combined graphical element into which the combined material is graphically displayed into at least one graphical element by:

and controlling to display the highlight mark for the selected one of the graphic elements while the edit box of the selected one of the graphic elements is displayed.

25. The apparatus of claim 20, wherein the splitting unit is configured to split the combined track into at least one element track into which the combined material is displayed in track form by:

26. The apparatus according to claim 20, wherein the editing display unit is configured to edit one of the at least one material element according to a user input by:

when a click input for a non-overlapping region between the at least one graphic element is received, one of the at least one graphic element corresponding to the non-overlapping region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

27. The apparatus according to claim 20, wherein the editing display unit is configured to edit one of the at least one material element according to a user input by:

when a click input to an overlap region between the at least one graphic element is received, one of the at least one graphic element located at a next level of the currently selected graphic element at the overlap region is selected, and one of the at least one element track corresponding to the one graphic element is selected.

28. The apparatus of claim 20, wherein the editing display unit is configured to edit one of the at least one material element according to a user input by:

when a click input for one of the at least one element track is received, the one element track is selected, and when one of the at least one graphic element corresponding to the one element track exists, the one graphic element is selected.

29. The apparatus of claim 20, wherein a hierarchical relationship between the at least one graphic element corresponds to a hierarchical relationship between respective ones of the at least one element track.

30. The apparatus of claim 20, wherein the editing display unit is configured to edit one of the at least one material element according to a user input by: adjusting a size, a position, and an angle of a selected one of the at least one graphic element according to a user input without affecting other ones of the at least one graphic element.

31. The apparatus of claim 20, wherein the editing display unit is configured to edit one of the at least one material element according to a user input by:

adjusting a time of the selected one of the at least one element track according to a user input without affecting other of the at least one element track.

32. The apparatus of claim 25, wherein the editing display unit is configured to edit one of the at least one material element according to a user input by: displaying a message inquiring whether to adjust a time of one element track beyond an adjustable time range of the current hierarchy when one end of the one element track of the at least one element track is dragged to a head time restriction region or a tail time restriction region of the current hierarchy according to a user input and the dragging operation is continued in a dragging direction.

33. The apparatus of claim 32, wherein the editing display unit is further configured to:

when an input for confirming that the time of the one element track is adjusted to exceed an adjustable time range of a current hierarchy is received, increasing a timeline view range of the at least one element track according to the drag operation of a user and adjusting the adjustable time of the one element track to [0, + ∞ ];

34. The apparatus of claim 20, wherein the editing display unit is configured to edit one of the at least one material element by:

35. The apparatus according to claim 34, wherein the editing display unit is configured to adjust the hierarchical relationship between the at least one material element by:

and determining whether an element track needs to be newly built in the at least one element track according to the staying interval and the staying time of one dragged element track in the at least one element track.

36. The apparatus of claim 35, wherein the editing display unit is configured to determine whether an element track needs to be newly created in the at least one element track by:

37. The apparatus of claim 35, wherein the editing display unit being configured to adjust the hierarchical relationship between the at least one material element by:

providing feedback to a user of a location at which the one element track was dropped when the drag for the one element track was released, according to the status style and location of the dragged one of the at least one element track.

38. The apparatus according to claim 20, wherein when the editing for the one material element is completed, the editing display unit is configured to:

displaying the combined track as a whole in the track area in a selected editing state, and correspondingly changing the time of the combined track according to the element track which finishes editing; and is

39. An electronic device, comprising:

a processor;

a memory for storing the processor-executable instructions,

wherein the processor is configured to execute the instructions to implement a method of adapting video composition material as claimed in any one of claims 1 to 19.

40. A computer readable storage medium having instructions which, when executed by a processor of an electronic device, enable an apparatus to perform a method of adapting video composition material as claimed in any one of claims 1 to 19.