WO2020062684A1

WO2020062684A1 - Video processing method and device, terminal, and storage medium

Info

Publication number: WO2020062684A1
Application number: PCT/CN2018/124781
Authority: WO
Inventors: 韩旭; 王海婷; 付平非
Original assignee: 北京微播视界科技有限公司
Priority date: 2018-09-30
Filing date: 2018-12-28
Publication date: 2020-04-02
Also published as: CN109120997A

Abstract

The embodiments of the present disclosure disclose a video processing method and device, a terminal, and a storage medium, wherein the method comprises: performing resolution detection on at least two video segments, and determining, according to the resolution of each video segment, respective aspect ratios of the video segments; determining a target aspect ratio on the basis of the aspect ratio and preset adjustment rules of each video segment; and configuring the at least two video segments to fit the target aspect ratio, so as to synthesize a target video on the basis of the at least two video segments.

Description

Video processing method, device, terminal and medium

This disclosure claims the priority of a Chinese patent application filed with the Chinese Patent Office on September 30, 2018, with an application number of 201811161951.1, the entire contents of which are incorporated herein by reference.

Technical field

The present disclosure relates to the field of Internet technologies, and for example, to a video processing method, device, terminal, and medium.

Background technique

The development of network technology has made video interactive applications very popular in people's daily lives.

For Internet companies with video interactive applications, meeting the needs of users and providing users with a satisfying product experience is a key factor that cannot be ignored to maintain the competitiveness of the enterprise. Aiming at a wide range of user groups, video interactive applications support providing users with multiple types of video resources, such as funny, humorous, scientific, current affairs, and life. At the same time, it also supports users to shoot different styles of video anytime, anywhere And add a variety of special effects, set different types of background music and so on.

However, the video editing function of the video interactive application software still has defects, resulting in poor video display effects.

Summary of the Invention

The present disclosure provides a video processing method, device, terminal, and medium to improve video display effects.

An embodiment of the present disclosure provides a video processing method. The method includes:

Performing resolution detection on at least two video segments, and determining an aspect ratio of each video segment according to the resolution of each video segment;

Determine the target aspect ratio according to the aspect ratio and preset adjustment rules of each video clip;

Adapting the at least two video segments to the target aspect ratio to synthesize a target video based on the at least two video segments.

An embodiment of the present disclosure further provides a video processing apparatus, where the apparatus includes:

A resolution detection module, configured to perform resolution detection on at least two video segments, and determine an aspect ratio of each video segment according to the resolution of each video segment;

A target aspect ratio determination module configured to determine a target aspect ratio according to an aspect ratio of each video clip and a preset adjustment rule;

The resolution adaptation module is configured to adapt the at least two video fragments to the target aspect ratio to synthesize a target video based on the at least two video fragments.

An embodiment of the present disclosure further provides a terminal, including:

One or more processing devices;

A storage device configured to store one or more programs,

When the one or more programs are executed by the one or more processing devices, the one or more processing devices are caused to implement the video processing method according to any embodiment of the present disclosure.

An embodiment of the present disclosure further provides a computer-readable storage medium storing a computer program, which is executed by a device to implement the video processing method according to any embodiment of the present disclosure.

The technical solution provided by the present disclosure solves the problem of poor display effect in the video editing process, realizes the uniform video resolution in the video synthesis process, improves the video display effect, and further improves the user's ability to synthesize a complete video based on video fragments. Video sharing experience; and, video-based interactive applications can support video editing operations, simplify the video editing process, and improve the convenience of video editing.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic flowchart of a video processing method according to an embodiment of the present disclosure;

2 is a schematic diagram of a video selection interface according to an embodiment of the present disclosure;

3 is a schematic diagram of a video editing interface provided with a video preview area according to an embodiment of the present disclosure;

4 is a schematic flowchart of another video processing method according to an embodiment of the present disclosure;

5 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of a hardware structure of a terminal according to an embodiment of the present disclosure.

detailed description

The disclosure is described below with reference to the drawings and embodiments. The specific embodiments described herein are only used to explain the disclosure, but not to limit the disclosure. In addition, for convenience of description, only some parts, but not all structures, related to the present disclosure are shown in the drawings.

Examples

FIG. 1 is a schematic flowchart of a video processing method according to an embodiment of the present disclosure. This embodiment may be applicable to a case where a video is processed, for example, editing a video resolution during a video synthesis process. The method can be executed by a video processing device, which can be implemented in software and / or hardware, and can be configured on any terminal with network communication functions, such as a smart phone, a computer, and an Apple iPad.

As shown in FIG. 1, the video processing method provided in the embodiment of the present disclosure may include the following steps.

S110. Perform resolution detection on at least two video segments, and determine an aspect ratio of each video segment according to a resolution of each video segment.

In the process of video synthesis using a video interactive application, considering the differences between the shooting modes of the video clips, the settings of the shooting camera parameters, and the shooting conditions, the resolution of multiple video clips selected by the user cannot always be consistent. If the video is synthesized based on multiple video clips with inconsistent resolutions, the final video picture display effect is not good. Therefore, it is necessary for the video interactive application to perform resolution detection on at least two video segments selected by the user to determine whether there are video segments with inconsistent resolutions in the video segments. When resolution inconsistencies are detected, the aspect ratio of each video segment is determined according to the resolution of each video segment.

S120. Determine a target aspect ratio according to an aspect ratio and a preset adjustment rule of each video segment.

In this embodiment, the preset adjustment rule defines the basis for determining the target aspect ratio in the video synthesis process. For example, it may include determining the target aspect ratio according to the screen resolution of the terminal, or determining the target aspect ratio according to a user-defined setting. Or the target aspect ratio is determined based on the aspect ratios of multiple video clips selected by the user.

In an embodiment, the preset adjustment rule includes selecting an aspect ratio with a maximum value from an aspect ratio of the video clip as a target aspect ratio. For example, based on the relationship between the resolution and the screen display ratio, three video segments a, b, and c with different resolutions are determined to have a 16: 9 aspect ratio corresponding to the resolution of video segment a and the resolution of video segment b. The corresponding aspect ratio is 15: 9, and the resolution of video segment c corresponds to the aspect ratio of 4: 3. 16: 9 is the largest of the three ratios. Then 16: 9 is the video segment a, b. And c target aspect ratio.

S130. Adapt each video segment to a target aspect ratio to synthesize a target video based on at least two video segments.

Through the adaptation operation of the video clips, the resolution of the video clips can be unified, thereby ensuring the display effect of the synthesized target video, which helps improve the user's experience of synthesizing a complete video based on the video clips for video sharing. Continuing the above example as an example, the target aspect ratio is 16: 9. By adapting the video segments a, b, and c to a 16: 9 display ratio, the screen display of the target video based on the video segments a, b, and c is synthesized The ratio will be unified to 16: 9, which avoids the phenomenon of inconsistent resolution of the display picture in the complete video obtained by the synthesis, and thus can ensure a better display effect.

In addition, since the video interactive application itself can support multiple video editing operations, users do not need to resort to other video synthesis tools, such as third-party applications for video synthesis, in the process of synthesizing video, thereby simplifying the video editing process and improving Convenience of video editing.

In an embodiment, on the basis of the above technical solution, the method further includes: in response to a video multiple selection request triggered on the video selection interface, acquiring at least two selected video clips, wherein the video selection interface triggers the video by triggering the video The specific logo of the shooting interface or audio details interface is displayed.

That is, when the user enables the video interactive application on the terminal, it can trigger the specific identification of the video shooting interface or music details interface of the video interactive application, such as the upload logo or share logo, etc., and switch from the current interface to the video selection interface, which is the video selection interface. The local video clips of the terminal can be displayed synchronously to facilitate user selection. In one embodiment, if the video selection interface is switched from the music detail interface, the user can use the audio of the music detail page as the background music of the synthesized video.

After the user triggers the video multiple selection request, the video interactive application records the selection order of the video clips selected by the user while obtaining the information of the video clips selected by the user. When the video is synthesized, the video can be synthesized based on the user's selection order. In this embodiment, in the process of synthesizing the video, the video may also be synthesized according to the arrangement order of the user-defined video clips.

During the user selection process, the user can touch the video thumbnail position on the video selection interface to preview the video to determine whether to select the video clip. In one embodiment, the duration of the video segment selected by the user is greater than or equal to the duration threshold, and the immediate length threshold determines the effective video segment that the user can select. For example, the duration threshold is set to 3 seconds, and when the duration of the video clip a selected by the user is 2 seconds, a prompt box (pop toast) may pop up to prompt the user that the currently selected video clip a is invalid and needs to be selected again. The number of user-selectable video clips can be adaptively set, for example, it can be set to 12, which is not limited in this embodiment. When the number of video clips selected by the user reaches the preset number requirement, other video thumbnails on the video selection interface can cover the white mask layer, and the user selection is no longer supported.

FIG. 2 is a schematic diagram of a video selection interface provided in this embodiment. As shown in FIG. 2, a multi-select control 21 is set on the video selection interface. After the user triggers a video multi-select request, each time a video clip is selected, the video clip The corresponding video thumbnail will display a number in the upper left corner, which is used as the recording information of the video clip selected by the user. In this embodiment, the multi-select control 21 can be set at any position on the edge of the interface. FIG. 2 is only an example, and the multi-select control 21 is set at the lower left.

In one embodiment, in the video synthesis process, in addition to the resolution editing of video clips, at least one of the following operations: cropping, playback speed editing, playback screen rotation, video deletion, and adding display effects can be performed. The above-mentioned editing operation involves overall editing with a composite continuous video as an editing object and individual editing with each video clip as an editing object. The effects of video editing, including resolution editing effects, can be displayed to the user through the video preview area of the video editing interface, that is, after the user's video editing operation is completed, the video interactive application will generate a video preview effect corresponding to the editing operation for User preview and saved in the terminal cache.

FIG. 3 is a schematic diagram showing a video editing interface provided with a video preview area in this embodiment as an example. As shown in FIG. 3, the video editing interface can be switched directly from the video selection interface. The video editing interface includes a video preview area 31, a video cropping area 32, and a video clip area 33. In this embodiment, the video preview area 31 is used to preview the video editing effect during the video editing process, such as the editing effect of the preliminary synthesized continuous video; the handles on the left and right sides of the video cropping area 32 can be moved as the user drags To adjust the preview video duration; the pointer in the video cropping area 32 moves as the preview video plays; the video clip area 33 displays multiple video clips selected by the user. By swiping left and right in this area, you can view the user All selected video clips. The edge position of the video editing interface or the gap between the video preview area 31 and the video cropping area 32 can be used to set editing controls, such as a cropping control, a playback speed editing control, a resolution editing control, and the like.

When an edit determination request triggered on the video editing interface is detected, that is, the user retains all the editing effects, the target video is saved in the video format to a specific storage location of the terminal; at the same time, if a video sharing request is detected, the target is saved Video is shared to the server.

The technical solution of the embodiment of the present disclosure first determines the aspect ratio of at least two video segments through resolution detection; then, determines the target aspect ratio according to the aspect ratio of each video segment and a preset adjustment rule; finally, at least Both video clips are adapted to the target aspect ratio to synthesize the target video based on at least two video clips, which solves the problem of poor display effects during video editing and achieves uniform video resolution during video synthesis , Improve the video display effect, thereby improving the user's experience of synthesizing a complete video based on video clips for video sharing; and because the video interactive application itself can support multiple video editing operations, users do not need to resort to additional videos during the process of synthesizing videos A compositing tool that makes video editing easier.

FIG. 4 is a schematic flowchart of another video processing method according to an embodiment of the present disclosure, and is described based on various optional solutions in the foregoing embodiment.

As shown in FIG. 4, the video processing method provided in the embodiment of the present disclosure may include the following steps.

S210: Perform resolution detection on at least two video segments, and determine an aspect ratio of each video segment according to the resolution of each video segment.

S220. Determine a target aspect ratio according to an aspect ratio and a preset adjustment rule of each video segment.

S230. Determine a target video clip from at least two video clips according to a video playback mode in the current state, where the video playback modes include horizontal screen playback and vertical screen playback.

Different video playback methods not only result in inconsistent resolution of the video picture, but also affect the user's viewing experience. Considering the differences between video clips, the playback mode of multiple video clips selected by the user in the current state is not necessarily the same. For example, some video clips may be played in horizontal screen and some video clips may be played in vertical screen. Or, in the process of editing a video clip, a difference occurs in the playback manner of multiple video clips. The purpose of determining the target video clip is to perform video rotation on the target video clip to finally obtain multiple video clips with a uniform playback mode. The target video segment may be any one of the video segments selected by the user.

S240. Rotate the playback picture of the target video clip to obtain at least two video clips in a unified video playback mode.

S250. Adapt at least two video clips with a uniform video playback mode to the target aspect ratio.

In an embodiment, the adaptation operation includes at least picture scaling and picture frame filling. The adaptation operations are based on maintaining the original aspect ratio of the video clip, and adjusting the video clip to the target aspect ratio, so that under the premise of achieving a uniform resolution, the video clip's picture will not be distorted.

For example, if the original aspect ratio of video segment a is greater than the target aspect ratio, the original aspect ratio of video segment a needs to be maintained to scale the display image of video segment a until the target aspect ratio is met; and When only one of the height or width of the display screen can meet the height or width of the corresponding target aspect ratio during the process, the other side can be filled with edges, such as filling the black edges, so that the entire display screen meets the target. Aspect Ratio.

The technical solution of the embodiment of the present disclosure first determines the aspect ratio of at least two video clips through resolution detection; then, determines the target aspect ratio according to the aspect ratio and preset adjustment rules of each video clip; finally, through the video Rotate to obtain at least two video clips with uniform playback mode and uniformly adapt the video clips in the current state to the target aspect ratio, which solves the problem of poor display effect during video editing and realizes the video synthesis process The unified video resolution in the video is consistent with the video playback method, which improves the video display effect, thereby improving the user's experience of synthesizing a complete video based on video clips for video sharing.

FIG. 5 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present disclosure. This embodiment is applicable to processing a video, for example, when editing a video resolution. The video processing device may be implemented in software and / or hardware, and may be configured on any terminal having a network communication function.

As shown in FIG. 5, the video processing device provided in the embodiment of the present disclosure may include a resolution detection module 510, a target aspect ratio determination module 520, and a resolution adaptation module 530. In this embodiment, the resolution detection module 510, It is configured to perform resolution detection on at least two video clips, and determine the aspect ratio of each video clip according to the resolution of each video clip; the target aspect ratio determination module 520 is set to be based on each existing video The aspect ratio and preset adjustment rules of the segment determine the target aspect ratio; the resolution adaptation module 530 is configured to adapt at least two video segments to the target aspect ratio to synthesize the target based on the at least two video segments video.

In an embodiment, the preset adjustment rule includes selecting an aspect ratio with a maximum value from an aspect ratio of at least two video clips as a target aspect ratio.

In an embodiment, the resolution adaptation module 530 includes: a target video segment determining unit configured to determine a target video segment from at least two video segments according to a video playback manner in a current state, where the video playback manner includes Horizontal and vertical playback; the target video clip rotation unit is set to rotate the playback video of the target video clip to get at least two video clips with the same video playback mode; the resolution adaptation unit is set to uniform video playback mode At least two video clips of are adapted to the target aspect ratio.

In an embodiment, the adaptation operation includes at least picture scaling and picture frame filling.

In an embodiment, the device further includes a video clip obtaining module configured to obtain at least two selected video clips in response to a video multiple selection request triggered on the video selection interface, wherein the video selection interface triggers the video by the user The specific logo of the shooting interface or audio details interface is displayed.

The video processing apparatus described above can execute the video processing method provided by any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of executing the method.

FIG. 6 is a schematic diagram of a hardware structure of a terminal according to an embodiment of the present disclosure. Reference is made below to FIG. 6, which illustrates a schematic structural diagram of a terminal 800 suitable for implementing embodiments of the present disclosure. The terminal in the embodiment of the present disclosure may include, but is not limited to, such as a mobile phone, a notebook computer, a digital broadcast receiver, a Personal Digital Assistant (PDA), a tablet computer (Portable Android Device, PAD), and a portable multimedia player ( Portable media (PMP), mobile terminals such as car terminals (such as car navigation terminals), and fixed terminals such as digital televisions (TVs), desktop computers, and the like. The terminal shown in FIG. 6 is only an example, and should not impose any limitation on the functions and scope of use of the embodiments of the present disclosure.

As shown in FIG. 6, the terminal 800 may include one or more processors (for example, a central processing unit, a graphics processor, etc.) 801 and a memory 808 configured to store one or more programs. Among them, the processor 801 may execute at least one appropriate according to a program stored in a read-only memory (ROM) 802 or a program loaded from the memory 808 to a random access memory (Random Access Memory (RAM) 803). Action and handling. In the RAM 803, at least one program and data required for the operation of the terminal 800 are also stored. The processor 801, the ROM 802, and the RAM 803 are connected to each other through a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

Generally, the following devices can be connected to the I / O interface 805: including input devices 806 such as a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc .; including, for example, a liquid crystal display (Liquid Crystal Display, LCD) An output device 807 such as a speaker, a vibrator, and the like; includes a memory 808 such as a magnetic tape, a hard disk, and the like; and a communication device 809. The communication device 809 may allow the terminal 800 to perform wireless or wired communication with other devices to exchange data. Although FIG. 6 shows a terminal 800 having a variety of devices, it is not required to implement or have all the devices shown. More or fewer devices may be implemented or provided instead.

According to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program borne on a computer-readable medium, the computer program containing program code for performing a method shown in a flowchart. In such an embodiment, the computer program may be downloaded and installed from the network through the communication device 809, or installed from the memory 808, or installed from the ROM 802. When the computer program is executed by the processor 801, the functions defined in the method of the embodiment of the present disclosure are executed.

The computer-readable medium of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. Examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, RAM, ROM, Erasable Programmable Read-Only Memory (EPROM) ) Or flash memory, optical fiber, compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, device, or device. In the present disclosure, a computer-readable signal medium may include a data signal that is transmitted in baseband or transmitted as part of a carrier wave, and the computer-readable signal medium carries computer-readable program code. Such a propagated data signal may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable signal medium may send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: electric wires, optical cables, radio frequency (RF), etc., or any suitable combination of the foregoing.

The computer-readable medium may be included in the terminal described above, or may exist alone without being assembled into the terminal.

The above computer-readable medium carries one or more programs, and when the one or more programs are executed by the terminal, the terminal is caused to perform resolution detection on at least two video fragments, and according to the resolution of each video fragment Determining an aspect ratio of each video segment; determining a target aspect ratio according to the aspect ratio of each video segment and a preset adjustment rule; and adapting the at least two video segments to the target aspect ratio Than synthesizing a target video based on the at least two video clips. .

Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination of programming languages, the programming languages including object-oriented programming languages such as Java, Smalltalk, C ++, Also included are conventional procedural programming languages-such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partly on the user's computer, as an independent software package, partly on the user's computer, partly on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network-including a local area network (LAN) or a wide area network (WAN)-or it can be connected to an external computer ( (E.g. using an Internet service provider to connect via the Internet).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, which contains one or more functions to implement a specified logical function Executable instructions. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented in a dedicated hardware-based system that performs the specified function or operation, or can be implemented in dedicated hardware In combination with computer instructions.

The units described in the embodiments of the present disclosure may be implemented by software or hardware. Among them, the name of the unit does not constitute a limitation on the unit itself in some cases.

Claims

A video processing method includes:

Performing resolution detection on at least two video segments, and determining an aspect ratio of each video segment according to the resolution of each video segment;

Determine the target aspect ratio according to the aspect ratio and preset adjustment rules of each video clip;

Adapting the at least two video fragments to the target aspect ratio to synthesize a target video based on the at least two video fragments.
The method according to claim 1, wherein the preset adjustment rule comprises selecting an aspect ratio having a maximum value from an aspect ratio of the at least two video clips as a target aspect ratio.
The method according to claim 1 or 2, wherein adapting the at least two video clips to the target aspect ratio comprises:

Determining a target video clip from the at least two video clips according to the video playback mode in the current state, wherein the video playback modes include horizontal screen playback and vertical screen playback;

Rotating the playback picture of the target video clip to obtain at least two video clips in a unified video playback mode;

At least two video clips unified in the video playing manner are adapted to the target aspect ratio.
The method according to any one of claims 1-3, wherein the adaptation operation includes at least picture scaling and picture frame filling.
The method according to claim 4, further comprising:

In response to a video multiple selection request triggered on a video selection interface, at least two selected video clips are acquired, wherein the video selection interface is displayed by triggering a specific identification of a video shooting interface or an audio detail interface.
A video processing device includes:

A resolution detection module, configured to perform resolution detection on at least two video segments, and determine an aspect ratio of each video segment according to the resolution of each video segment;

A target aspect ratio determination module configured to determine a target aspect ratio according to an aspect ratio of each video clip and a preset adjustment rule;

The resolution adaptation module is configured to adapt the at least two video fragments to the target aspect ratio to synthesize a target video based on the at least two video fragments.
The apparatus according to claim 6, wherein the preset adjustment rule comprises selecting an aspect ratio having a maximum value from an aspect ratio of the at least two video clips as a target aspect ratio.
The apparatus according to claim 6 or 7, wherein the resolution adaptation module comprises:

The target video clip determining unit is configured to determine a target video clip from the at least two video clips according to a video playback method in a current state, wherein the video playback method includes horizontal screen playback and vertical screen playback;

A target video clip rotation unit configured to rotate a playback picture of the target video clip to obtain at least two video clips in a unified video playback manner;

The resolution adaptation unit is configured to adapt at least two video clips unified in the video playing manner to the target aspect ratio.
A terminal including:

At least one processor;

Memory, configured to store at least one program,

When the at least one program is executed by the at least one processor, the at least one processor implements the video processing method according to any one of claims 1 to 5.
A computer-readable storage medium stores a computer program that, when executed by a processing device, implements the video processing method according to any one of claims 1 to 5.