CN114979748B

CN114979748B - Video processing method and device

Info

Publication number: CN114979748B
Application number: CN202210570972.9A
Authority: CN
Inventors: 黄凌初
Original assignee: Shanghai Bilibili Technology Co Ltd
Current assignee: Shanghai Bilibili Technology Co Ltd
Priority date: 2022-05-24
Filing date: 2022-05-24
Publication date: 2024-02-23
Anticipated expiration: 2042-05-24
Also published as: CN114979748A

Abstract

The application provides a video processing method and a device, wherein the video playing comprises the following steps: playing the target video through a program rendering layer of the video playing program; under the condition that a play switching instruction submitted by aiming at the video play program is received, determining a system rendering layer corresponding to the target system; moving the target video from the program rendering layer to a target window of the system rendering layer, and playing the target video on the uppermost layer of the client display device through the target window; the system rendering layer and the program rendering layer have different playing strategies, the target window occupies part of the display area of the display device, and by the method, the target video is realized without being limited to the corresponding video playing program for video playing, the playing position and the playing form are flexibly switched, the video playing limitation is reduced, and the user experience is improved.

Description

Video processing method and device

Technical Field

The present application relates to the field of video technologies, and in particular, to two video processing methods. The present application relates to two video processing apparatuses, a computing device, and a computer-readable storage medium.

Background

With the development of internet technology and the popularization of mobile terminals, the proportion occupied by multimedia resources is gradually increased in the means of acquiring information, and in the prior art, in order to meet the increasing demands of people for acquiring multimedia resources, various video playing programs are generated accordingly, however, for the video playing program for realizing video resource playing, the application range of the video playing program is often limited due to the fact that the video playing program only operates under a proprietary system environment is considered at the beginning of design, and the video playing program cannot function under any system environment, and even though the video playing program can operate in the corresponding system environment through related operation protocols, the situation that the functions cannot be fully expanded and the user experience is poor is likely to occur.

Disclosure of Invention

In view of this, the embodiments of the present application provide two video processing methods. The application relates to two video processing devices, a computing device and a computer readable storage medium, so as to solve the problems that in the prior art, a video playing program cannot run in a part of system environments or partial functions cannot be unfolded during running, and user experience is poor.

According to a first aspect of an embodiment of the present application, there is provided a video processing method applied to a client, where the client runs a target system and carries a video playing program, including:

playing the target video through a program rendering layer of the video playing program;

under the condition that a play switching instruction submitted by aiming at the video play program is received, determining a system rendering layer corresponding to the target system;

moving the target video from the program rendering layer to a target window of the system rendering layer, and playing the target video on the uppermost layer of the client display device through the target window;

the system rendering layer and the program rendering layer have different playing strategies, and the target window occupies part of the display area of the display device.

Optionally, after the target video is played by the program rendering layer of the video playing program, the method further includes:

creating a space occupying video according to a preset space occupying video rule;

performing invisible playing on the occupying video on a target window of the system rendering layer;

accordingly, the moving the target video from the program rendering layer to the target window of the system rendering layer includes:

Removing the occupied video in a target window of the system rendering layer;

and moving the target video from the program rendering layer to a target window of the system rendering layer.

Optionally, creating the occupied video according to the preset occupied video rule includes:

constructing a space occupying video with a sound state being a mute state and being played circularly according to the space occupying video rule;

wherein, the video frame of the occupied video is a preset monochromatic video frame.

Optionally, the performing the invisible playing of the placeholder video on the system rendering layer includes:

setting the sound state of the occupied video to be a mute state, and setting the picture state of the occupied video to be an invisible state to obtain a target occupied video;

and playing the target occupying video on the system rendering layer.

Optionally, the playing the target video by the program rendering layer of the video playing program includes:

acquiring a play strategy of the program rendering layer;

creating a play switching control according to a play strategy of the program rendering layer, playing the target video on the program rendering layer, and displaying the play switching control;

Correspondingly, under the condition that a play switching instruction submitted by the video play program is received, determining a system rendering layer corresponding to the target system comprises the following steps:

and executing the step of determining the system rendering layer corresponding to the target system under the condition that a play switching instruction submitted by aiming at the play switching control is received.

Optionally, the playing the target video on the uppermost layer of the client display device through the target window includes:

acquiring a playing strategy of the system rendering layer;

adjusting the playing priority of a target window of the system rendering layer according to the playing strategy of the system rendering layer, and playing the target video by adjusting the target window with the playing priority;

and adjusting the target window with the playing priority to be finished at the uppermost layer of the client.

Optionally, the receiving a play switching instruction submitted for the target video program includes:

detecting a program state of the video playing program;

and under the condition that the program state is a play switching state and a program exit instruction is received, generating the play switching instruction according to the program exit instruction.

Optionally, the moving the target video from the program rendering layer to a target window of the system rendering layer, and playing the target video on an uppermost layer of the client display device through the target window includes:

switching the program rendering layer in the player carried by the client to the system rendering layer, and moving the target video from the program rendering layer to a target window of the system rendering layer;

and playing the target video on the uppermost layer of the display equipment of the client side through the player.

Optionally, playing, by the player, the target video at an uppermost layer of the client display device includes:

reading video attribute information, barrage information and display information of the target video according to a playing strategy of the system rendering layer;

and configuring the video attribute information, the bullet screen information and the display information aiming at the player, and playing the target video at the uppermost layer of the display equipment of the client according to the configuration result.

Optionally, after playing the target video at the uppermost layer of the client display device through the target window, the method further includes:

Moving the target video from a target window of the system rendering layer to the program rendering layer under the condition that a play conversion instruction submitted for the target system is received;

and playing the target video through the program rendering layer.

According to a second aspect of the embodiments of the present application, there is provided another video processing method applied to a client, where the client runs a target system and carries a video playing program, including:

playing the target video through a system rendering layer corresponding to the target system;

determining a program rendering layer of the video playing program under the condition of receiving a playing conversion instruction submitted for the target system;

moving the target video from a target window of the system rendering layer to the program rendering layer, and playing the target video through the program rendering layer;

According to a third aspect of embodiments of the present application, there is provided a video processing apparatus, including:

a program rendering layer playing module configured to play a target video through a program rendering layer of the video playing program;

The system rendering layer determining module is configured to determine a system rendering layer corresponding to the target system under the condition that a play switching instruction submitted by the video playing program is received;

and the program rendering layer moving module is configured to move the target video from the program rendering layer to a target window of the system rendering layer, and play the target video on the uppermost layer of the client display device through the target window, wherein the playing strategy of the system rendering layer is different from that of the program rendering layer, and the target window occupies part of the display area of the display device.

According to a fourth aspect of embodiments of the present application, there is provided another video processing apparatus, including:

the system rendering layer playing module is configured to play the target video through a system rendering layer corresponding to the target system;

a program rendering layer determining module configured to determine a program rendering layer of the video playing program in case of receiving a play conversion instruction submitted for the target system;

and the system rendering layer moving module is configured to move the target video from a target window of the system rendering layer to the program rendering layer and play the target video through the program rendering layer, wherein the playing strategy of the system rendering layer is different from that of the program rendering layer, and the target window occupies part of the display area of the display device.

According to a fifth aspect of embodiments of the present application, there is provided a computing device comprising a memory, a processor and computer instructions stored on the memory and executable on the processor, the processor implementing the steps of the video processing method when executing the instructions.

According to a sixth aspect of embodiments of the present application, there is provided a computer readable storage medium storing computer instructions which, when executed by a processor, implement the steps of the video processing method.

According to the video processing method, the target video is played through the program rendering layer of the video playing program; under the condition that a play switching instruction submitted by aiming at the video play program is received, determining a system rendering layer corresponding to the target system; moving the target video from the program rendering layer to a target window of the system rendering layer, and playing the target video on the uppermost layer of the client display device through the target window; the system rendering layer and the program rendering layer have different playing strategies, and the target window occupies part of the display area of the display device.

According to the embodiment of the application, the target video is switched from the program rendering layer to the system rendering layer, the effect of video playing in any system is achieved, the video playing is not limited to the corresponding video playing program, and because the video playing program and the target system have different playing strategies on the target video, the video playing process is carried out on the target window of the system rendering layer of the target system, the playing process is regulated on the uppermost layer of the client display device, the size range of the target window is regulated, the video playing in the picture-in-picture window mode is achieved, and the user experience is improved.

Drawings

FIG. 1 is a flow chart of a video processing method according to an embodiment of the present application;

FIG. 2 is a flow chart of an automated video processing method provided in an embodiment of the present application;

FIG. 3 is a flow chart of a manual video processing method according to an embodiment of the present application;

FIG. 4 is a flow chart of another video processing method according to an embodiment of the present application;

FIG. 5 is a process flow diagram of a video processing method applied to PIP according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of another video processing apparatus according to an embodiment of the present application;

FIG. 8 is a block diagram of a computing device according to one embodiment of the present application.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is, however, susceptible of embodiment in many other ways than those herein described and similar generalizations can be made by those skilled in the art without departing from the spirit of the application and the application is therefore not limited to the specific embodiments disclosed below.

The terminology used in one or more embodiments of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of one or more embodiments of the application. As used in this application in one or more embodiments and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present application refers to and encompasses any or all possible combinations of one or more of the associated listed items.

It should be understood that, although the terms first, second, etc. may be used in one or more embodiments of the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, a first may also be referred to as a second, and similarly, a second may also be referred to as a first, without departing from the scope of one or more embodiments of the present application. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.

First, terms related to one or more embodiments of the present application will be explained.

Picture-in-picture: a container provided by a mobile operating system that can play video outside of an application.

BGRenderer (hereinafter referred to as BGR): rendering layer of ijkplay player.

AVSampleBufferDisplayLayer (hereinafter SBDL): a mobile operating system provides a video rendering layer.

In the present application, two video processing methods are provided, and the present application relates to two video processing apparatuses, one computing device, and one computer-readable storage medium, which are described in detail in the following embodiments one by one.

Fig. 1 shows a flowchart of a video processing method according to an embodiment of the present application, which specifically includes the following steps:

step S102: and playing the target video through a program rendering layer of the video playing program.

The video processing method is applied to the client, an operating system corresponding to the client is a target system, and the client also bears a video playing program; the client can be understood as devices for playing video by users, including but not limited to devices capable of playing video such as mobile phones, computers, tablet computers, smart watches, and the like; the target system can be understood as an operating system running on the client, such as an Android system, an IOS system and the like; the video playing program can be understood as software, web pages, APP and the like applied to video playing; the program rendering layer can be understood as a rendering layer which is built based on video playing software and is specific to a video playing program, and is used for executing an instruction issued by the video playing program and rendering related picture images in the process of playing target video; the target video may be understood as a video being played in a video playing program, which is subsequently processed based on the received instructions.

Based on the above, the video playing program in the client side will render and play the target video based on the program rendering layer corresponding to the video playing program. It should be noted that, for the specific display form of the target video in the program rendering layer, such as the picture proportion, the related volume control, the definition control, etc., how to set is determined by the actual application scene, and the embodiment is not limited. In this way, playback of the target video is achieved.

Further, under the condition that the target video is played, the rendering layer of the target video needs to be switched subsequently, and under the premise, in order to improve user experience, a manual switching mode needs to be configured, so that the requirement of switching the rendering layer of the target video display by a user is ensured, and in the embodiment, the specific implementation mode is as follows:

acquiring a play strategy of the program rendering layer; creating a play switching control according to a play strategy of the program rendering layer, playing the target video on the program rendering layer, and displaying the play switching control;

the play policy of the program rendering layer may be understood as a preset play policy, and the video played in the program rendering layer needs to adhere to the policy; a play switch control may be understood as a control for a user to manually switch the rendering layer of a target video play.

Based on the method, a play strategy corresponding to the program rendering layer is obtained, then a preset-form switching control is created according to the rule of the play strategy, and when the program rendering layer plays the target video, the play switching control is displayed in the program rendering layer at the same time.

For example, the operating system C is running on the handset B of user a, and the video playback app D is installed on B. For the target video E1, playing is performed on the rendering layer BGR of app D of the mobile phone B. At the moment, a playing strategy corresponding to the BGR is obtained, a playing switching control F is created based on the playing strategy corresponding to the BGR, and the F is displayed on the BGR.

In sum, the play switching control is created, so that the requirement of a user for manually switching the rendering layer of the target video play can be met, and the user experience is enhanced.

Further, in the system rendering layer, a video playing task may be being executed, in this case, if the rendering layer for playing the target video is switched to the system rendering layer, a situation that the system rendering layer is occupied and cannot be switched may occur, and in order to solve this problem, in this embodiment, the implementation manner is as follows:

creating a space occupying video according to a preset space occupying video rule; and performing invisible playing on the occupying video in a target window of the system rendering layer.

The occupied video can be understood as a video which is established to occupy the system rendering layer in advance in order to ensure that the situation that the switching failure is caused by the playing task of other videos which are being executed does not occur when the target video is switched to the system rendering layer for playing; the occupied video rule may be understood as a rule for specifying the form of the created occupied video, including sound information and video frame information of the occupied video; the target window may be understood as a window for video playing, which exists in a system rendering layer and occupies a part of a client display device, and may be moved on the display device, where a part of operation controls may be integrated, and the user may implement, by manipulating the window, a change of a video playing manner in the target window, such as a volume, a playing speed, etc. of a video, where a specific integrated control type and number of controls are determined by an actual use scenario, which is not limited in this embodiment.

Based on this, by setting the occupation video rule in advance, creating the occupation video meeting the preset form, and then playing the occupation video on the target window of the system rendering layer, it should be noted that, in order not to affect the playing of the target video in the program rendering layer, the process of playing the occupation video is invisible to the user, and the implementation of the invisible mode may be that the transparency of the occupation video is set to 100%, or the playing priority of the target window is set to the lowest layer, so that the picture in the display device shields the target window, and the specific invisible setting method is determined by the actual use scenario, which is not limited in this embodiment.

Along the above example, the occupied video E2 is created by the preset occupied video rule, and then the pd-in-pd widget is played on the rendering layer SBDL corresponding to the operating system C, and because the playing priority of the pd-in-pd widget at this time is set to the lowest layer, the pd-in-pd widget is hidden under the desktop, so that the playing process is invisible.

In sum, the occupied video occupies the system rendering layer in advance, so that when the target video is switched to the system rendering layer to play, the situation that the system rendering layer is occupied by other video playing tasks being executed and the switching is failed is avoided.

Further, when the occupied video performs invisible playing, the occupied video consumes playing resources of the system, and in order to reduce consumption, in this embodiment, the specific implementation manner is as follows:

constructing a space occupying video with a sound state being a mute state and being played circularly according to the space occupying video rule; wherein, the video frame of the occupied video is a preset monochromatic video frame.

The sound state may be understood as an audio playing state in the video playing process, such as volume, stereo, etc.; the mute state can be understood as that the volume of the video is 0; monochrome video frames are understood to be video frames of only one color.

Based on the above, according to the occupied video rule, a occupied video with volume of 0 and only one pure-color video frame is circularly played is created.

According to the above example, the occupied video E2 with the volume of 0 and circularly played by one pure black video frame is created through the occupied video rule.

In summary, by the method, the created occupied video does not influence the related content being played by the client in sound, and the video frames played in a single-color cycle also greatly reduce the playing resource consumption of the video. In this case, in order to ensure that the play screen of the target video is not affected by the occupied video, the color of the monochrome video frame may be set to be colorless.

Further, besides setting the color of the monochrome video frame of the occupied video to be colorless, the playing picture of the target video can be realized not to be affected by the occupied video by setting the picture state in the display process of the occupied video, and in the embodiment, the specific implementation mode is as follows:

setting the sound state of the occupied video to be a mute state, and setting the picture state of the occupied video to be an invisible state to obtain a target occupied video; and playing the target occupying video on the system rendering layer.

The target occupied video is understood to be the occupied video set through the picture state.

Based on this, in order to ensure that the playing sound of the target video is not affected by the occupied video, the sound of the occupied video is set to 0, and then the picture state of the occupied video is set to an invisible state, it should be noted that, in the invisible state, only the occupied video needs to be ensured to be unable to be observed by a user, whether the picture on the display screen of the current client is captured as the picture of the occupied video, the transparency of each video frame in the occupied video is set to 100%, or the target window for playing the occupied video is placed at the lowest layer of the client display device, and is the method of setting the invisible state, which mode is specifically adopted is determined by the actual application scene, which is not limited in this embodiment. And playing the occupied video on a system rendering layer.

Along the above example, the volume of the occupied video E2 is set to 0, then the transparency thereof is set to 100%, and then the set E2 is played in a picture-in-picture widget on SBDL.

In summary, by the method, the form of the occupied video, any volume and the occupied video of any picture can be realized in such a setting mode, and playing of the target video is not affected by playing on the system rendering layer.

Step S104: and under the condition that a play switching instruction submitted by the video play program is received, determining a system rendering layer corresponding to the target system.

Specifically, after the program rendering layer displays the target video, if a play switching instruction is received, the rendering layer needs to change the target video to play.

The play switching instruction can be understood as an instruction for indicating that the target video needs to be switched to the play of the rendering layer; the system rendering layer can be understood as a rendering layer which is built based on the target system and is specific to the target system, and is used for executing an instruction issued by the target system of the client, so that the video image is rendered in the process of playing the related video through the picture-in-picture window.

Based on the instruction, aiming at the instruction which is submitted by the video playing program and indicates that the target video needs to be played by switching the rendering layer, when the instruction is received by a client, determining a system rendering layer corresponding to a target system; by determining the system rendering layer, the rendering layer to which the target video needs to be switched is also determined.

Further, in a scenario, it may be provided that when the user exits the video playing program, the rendering layer of the target video is automatically switched, and in this embodiment, the specific implementation manner is as follows:

Detecting a program state of the video playing program; and under the condition that the program state is a play switching state and a program exit instruction is received, generating the play switching instruction according to the program exit instruction.

The program state may be understood as indicating whether the video playing program has started a function of automatically switching the rendering layer for the target video; the play switching state can be understood as that the video play program starts the function of automatically switching the rendering layer for the target video; the exit instruction may be understood as an instruction indicating that the user exits the video playing program to play the target video, for example, when the mobile phone views the video, the video exiting the playing returns to the video list page, or exits the video playing program and returns to the desktop of the mobile phone, etc., so that it can be seen that the exit is not only a case, but also a specific selection of which case is determined according to the actual use situation, and the embodiment is not limited.

Based on the above, whether the video playing program starts the function of automatically switching the rendering layer for the target video is detected, and if the video playing program starts the function of automatically switching the rendering layer for the target video and receives the program exit instruction, a playing switching instruction is generated.

Along the above example, the program state of app D is detected, and the program state is detected to be the play switching state, and then the play switching instruction G2 is generated according to the exit instruction after the instruction G1 for exiting the play window of the target video E1 is received.

In summary, by this way, when the preset trigger condition is satisfied, a play switching instruction is generated to instruct the next rendering layer switching of the target video.

Further, there is a manual triggering manner besides the rendering layer switching of the processing automation triggering target video, and in this embodiment, the specific implementation manner is as follows:

The play switching control created through the steps is used for executing the subsequent step of switching the rendering layer of the target video after receiving a play switching instruction submitted for the play switching non-space.

Along the above example, after receiving the click of the control F by the user a, the step of determining the system rendering layer corresponding to the target system is executed.

In summary, besides automatically triggering the rendering layer switching of the target video, a manual triggering mode exists, so that the control of the user on the rendering layer switching of the target video is improved, and the operability is improved.

Step S106: and moving the target video from the program rendering layer to a target window of the system rendering layer, and playing the target video on the uppermost layer of the client display device through the target window.

Specifically, after receiving the play switching instruction and determining the system rendering layer, the rendering layer of the target video needs to be switched, and the target video is displayed based on the switched rendering layer.

The playing policy may be understood as a policy that can affect the effect of playing the video, such as the size, position, and sound channel of the playing interface, where the video information specifically included in the playing policy is determined by the actual use scenario, which is not limited in this embodiment.

Based on the method, a target video is moved from a program rendering layer to a target window of a system rendering layer, then the target video is played according to a playing strategy of the system rendering layer different from the program rendering layer, in the process, the target video is displayed in the target window, the target window is displayed at the uppermost layer of display equipment of a client, that is, in the process of displaying the target video in the target window, the picture of the target video is displayed at the highest priority in the display equipment of the client, and other pictures in the display equipment cannot form shielding on the target window for displaying the target video; when the target window is displayed in the display device, the display area of the display device is not occupied, but only a part of the display area is occupied, the size of the occupied area can be adjusted by a user, the specific size is determined by the actual use situation, and the embodiment is not limited. In addition, in the process of displaying the target video in the target window, since the target window exists in the system rendering layer, the target window displaying target video needs to adhere to the playing policy of the system rendering layer, and it needs to be noted that there is no link between the playing rules of the system rendering layer and the program rendering layer, at this time, the playing rules of the system rendering layer may be set to be consistent with the playing rules of the program rendering layer, or may be set differently, and the specific set parameters are determined by the actual use scenario, which is not limited in this embodiment.

Further, if there is a placeholder video in the system rendering layer, in this embodiment, the specific implementation manner is as follows:

removing the occupied video in a target window of the system rendering layer; the target video is moved from the program rendering layer to the system rendering layer.

The method comprises the steps of removing occupied video existing in a system rendering layer, and then moving target video from the program rendering layer to the system rendering layer. When the target video is moved from the program rendering layer to the system rendering layer, the target video may be selectively removed from the program rendering layer, or the target video may be set to a mute state like a space occupying video, the picture is set to an invisible state, and the specific selection mode is determined by the actual use scenario, which is not limited in this embodiment.

Along the above example, E2 is removed in the PIP portlet of the SBDL, then E1 is removed in the BGR, and E1 is moved to the PIP portlet of the SBDL.

In sum, by the method, the occupied video can always occupy the system rendering layer, so that other videos cannot be played on the system rendering layer, and the situation that the target video cannot be switched due to the fact that the system rendering layer is occupied when the target video is switched is ensured. The smoothness and smoothness of the switching are ensured.

Further, when there are frames that are played and can be displayed between the two rendering layers, the program rendering layer may shield the system rendering layer, and in order to solve this problem, in this embodiment, the specific implementation manner is as follows:

acquiring a playing strategy of the system rendering layer; adjusting the playing priority of a target window of the system rendering layer according to the playing strategy of the system rendering layer, and playing the target video by adjusting the target window with the playing priority; and adjusting the target window with the playing priority to be finished at the uppermost layer of the client.

The playing priority may be understood as indicating a positional relationship between a system rendering layer and a program rendering layer, where when a video is played, a rendering layer with a high playing priority is an upper layer of a rendering layer with a low playing priority.

Based on the method, the system rendering layer is queried to obtain a playing strategy corresponding to the system rendering layer, and then the playing priority of the system rendering layer is adjusted according to the playing strategy of the system rendering layer, so that the relation between the playing target video of the system rendering layer and the system rendering layer displaying the video playing program interface is determined. It should be noted that, the picture displayed in the system rendering layer is at the upper layer of the picture displayed in the program rendering layer, and the picture displayed in the program rendering layer may be covered.

Along with the above example, the play policy of the SBDL is obtained, and then the play priority of the pd-in-pd window of the SBDL is adjusted based on the adjustment, so that the play priority of the pd-in-pd window of the SBDL, which is the lowest when the E2 is originally played, is adjusted to the highest, and then the pd-in-pd window based on the SBDL can play E1 at the uppermost layer of the mobile phone.

In conclusion, by setting the playing priority, the playing order is ensured, so that the target video played in the system rendering layer is not blocked.

Further, the process of switching the rendering layer of the target video is actually a process of switching the rendering layer by the player playing the target video, and in this embodiment, the specific implementation manner is as follows:

switching the program rendering layer in the player carried by the client to the system rendering layer, and moving the target video from the program rendering layer to a target window of the system rendering layer; and playing the target video on the uppermost layer of the display equipment of the client side through the player.

The player can be understood as software capable of playing video stored in a digital signal form, and it should be noted that, in the embodiment, the player playing the target video is embedded in the video playing program, and the player playing the occupied video is the content in the target system.

Based on the method, a built-in player in the video playing program switches a program rendering layer into a system rendering layer, and then the target video is rendered by the player in the system rendering layer in a related surface changing manner and played by related audio, so that the target video is played in the system rendering layer.

Along the above example, app D uses a matched player ijkplay to switch the rendering layer facing the ijkplay from BGR to SBDL, and then the ijkplay plays E1 on the picture-in-picture widget of SBDL; it should be noted that, when E2 is played on SBDL, the player AVPlayer matched with the operating system C plays E2 through the small window in picture.

In conclusion, the player is used for realizing the switching of the rendering layers, so that the operability is improved, development and implementation of related equipment, software and the like of the video processing method are facilitated, and development cost is saved.

Further, in order to solve the problem, if the playing form is consistent with that of the target video in the program rendering layer in the process of playing the target video by aiming at the system rendering layer, the switching is meaningless to the user in the process of switching the rendering layer, and in this embodiment, the specific implementation manner is as follows:

reading video attribute information, barrage information and display information of the target video according to a playing strategy of the system rendering layer; and configuring the video attribute information, the bullet screen information and the display information aiming at the player, and playing the target video at the uppermost layer of the display equipment of the client according to the configuration result.

The video attribute information may be understood as information about volume, picture size, horizontal-vertical ratio, sharpness, etc. of the video; the bullet screen information can be understood as information about whether the bullet screen of the video is displayed, fonts, shielding prevention and the like; the display information can be understood as information about the display window shape, display window position, etc. of the video; it should be noted that, the information included in the video attribute information, the bullet screen information, and the display information is not fixed, and what information is specifically included is determined by the actual application scenario, which is not limited in this embodiment.

Along the above example, the video attribute information, the bullet screen information and the display information of the E1 are read according to the playing policy of the SBDL, and determined according to the reading result, the E1 adopts 1080P definition in the playing process, the bullet screen is not displayed, the display is performed in a floating window mode with the size of 4cm to 3cm, and then the ijkplay displays the E1 in the picture-in-picture small window of the SBDL based on the requirements.

In summary, various extension functions can be implemented in the above manner, such as, for example, implementing the picture-in-picture playing of the target video. It should be noted that, the implementation of the extended functions based on the configuration of the video attribute information, the bullet screen information, and the presentation information is not limited by how the extended functions are implemented based on different configurations, which is determined by the actual application scenario.

Further, in addition to switching the rendering layer of the target video from the program rendering layer to the system rendering layer, the system rendering layer may be reversely converted into the backhaul rendering layer, and in this embodiment, the specific implementation manner is as follows:

moving the target video from a target window of the system rendering layer to the program rendering layer under the condition that a play conversion instruction submitted for the target system is received; and playing the target video through the program rendering layer.

The play conversion instruction is understood to be similar to the play switching instruction, but is an instruction for instructing the rendering layer to convert the backhaul rendering layer from the system rendering layer.

Based on this, the process of converting the instruction of the return sequence rendering layer from the system rendering layer to the rendering layer is similar to the process of switching the rendering layer from the program rendering layer to the system rendering layer, and will not be described herein.

In conclusion, the rendering layer of the target video is switched from the rendering layer to the system rendering layer, the return sequence rendering layer is switched, the flexibility of switching the rendering layer of the target video is guaranteed, and the user experience is improved.

According to the video processing method, the target video is played through the program rendering layer of the video playing program; when a play switching instruction submitted by the video playing program is received, moving the target video from the program rendering layer to a target window of a system rendering layer corresponding to the target system, and playing the target video at the uppermost layer of the client display device, so that the target video is not limited to the corresponding video playing program for video playing, the playing position and the playing form are flexibly switched, the video playing limitation is reduced, and the user experience is improved.

A flowchart of an automated video processing method according to an embodiment of the present application shown in fig. 2, wherein a flow of performing a video processing method in a system of IOS 15 and above is disclosed; in the process, the playing of the target video is started at first, such as 'users entering playing above IOS 15 and also starting playing' in the figure; then creating a space occupying video, and playing the space occupying video on a system rendering layer, wherein the space occupying video is shown as a figure of creating an AVplayer circulation playing static silent video; then playing the occupied video on a system rendering layer until an exit instruction appears, such as 'adding the AVplayer into a view level and hosting the AVplayer to the picture-in-picture' in the figure, and 'waiting for the system to enter a background to automatically call the picture-in-picture'; normally exiting under the condition that the program state is not the play switching state, such as 'exiting the picture-in-picture process and cleaning data' in the figure; judging the current AVSampleBufferDisplayLayer in the figure under the condition that the program state is a play switching state, and then switching the rendering layer according to the judging result, wherein the method is equivalent to determining the rendering layer where the target video is located; and then playing the target video according to the system rendering layer, such as ' obtaining the current AVSampleBufferDisplayLayer ', ' hosting the AVSampleBufferDisplayLayer to the picture-in-picture playing source ' and ' switching the picture-in-picture playing source to the current player ', and the app exits the playing page '.

According to a flowchart of a manual video processing method provided in an embodiment of the present application shown in fig. 3, a play switching instruction obtained based on a play switching control is received, such as "click a picture-in-picture button" of the graph; the similar determination process of the rendering layer where the determined target video is located is followed, such as the figure that the current rendering layer is AVSampleBufferDisplayLayer; the content in the later figure is similar to the content of the automatic part, and the target video is played according to the system rendering layer, which is not described here again.

Fig. 4 shows a flowchart of another video processing method according to an embodiment of the present application, specifically including the following steps:

step S402: and playing the target video through a system rendering layer corresponding to the target system.

Step S404: and determining a program rendering layer of the video playing program under the condition that a playing conversion instruction submitted for the target system is received.

Step S406: and moving the target video from a target window of the system rendering layer to the program rendering layer, and playing the target video through the program rendering layer.

Specifically, when the target video is played in the system rendering layer of the target system, that is, when the target video is played in the target window of the system rendering layer, if a play conversion instruction is received, it is stated that a user needs to convert the target video originally displayed in the target window into the program rendering layer for playing, in this case, the program rendering layer to which the target video needs to be converted is first determined, then the target video is extracted from the target window of the system rendering layer, the target video is moved to the program rendering layer, and the target video is played by the program rendering layer, and at this time, the playing of the target video needs to follow the playing policy of the program rendering layer, that is, playing of the target video is performed according to the video playing rule of the program rendering layer, and it is to be noted that the setting of the playing policy of the program rendering layer is determined by the actual use scenario, that is, in this embodiment, the setting of parameters is not limited. In addition, the target window of the system rendering layer is the same as the target window of the system rendering layer in the video processing method related in the present specification, and this embodiment is not described herein.

It should be noted that, the video processing method for converting the instruction of the rendering layer from the system rendering layer to the backhaul rendering layer is similar to the video processing method for switching the rendering layer from the program rendering layer to the system rendering layer in the executing process, and will not be described herein.

According to the other video processing method, the target video is played through the system rendering layer of the target system; when a play switching instruction submitted by the target system is received, moving the target video from a target window of a program rendering layer to the program rendering layer corresponding to the video playing program, and playing the target video through the program rendering layer, so that the target video is played by switching a return sequence rendering layer from the system rendering layer, video playing limitation is reduced, and user experience is improved.

The video processing method provided in the present application will be further described with reference to fig. 5 by taking an application of the video processing method to picture-in-picture as an example. Fig. 5 shows a process flow chart of a video processing method applied to a picture-in-picture according to an embodiment of the present application, which specifically includes the following steps:

step S502: and acquiring a playing strategy of the program rendering layer.

Specifically, when the user views the video by using the IOS system mobile phone, the video playing program is cut out through the pip button, and under the condition of generating the pip floating window, the playing strategy of the rendering layer corresponding to the video APP is obtained first.

Step S504: and creating a play switching control according to the play strategy of the program rendering layer, playing the target video on the program rendering layer, and displaying the play switching control.

Specifically, a picture-in-picture key is created according to a play strategy of a rendering layer corresponding to a video APP, then the picture-in-picture key is added into the rendering layer corresponding to the video APP, and a target video is played on the rendering layer.

Step S506: and constructing the occupation video with the sound state being a mute state and circularly played according to the occupation video rule.

Specifically, the occupied video is created according to the occupied video rule, wherein the occupied video is mute, and the video of the monochrome video frame is circularly played.

Step S508: and setting the picture state of the occupied video to be an invisible state to obtain the target occupied video.

Specifically, the transparency of the occupied video is adjusted to 100%.

Step S510: and playing the target occupying video on a target window of the system rendering layer.

Specifically, the floating window display is shown in the Picture In Picture (PIP) of the SBDL layer of the IOS system of the mobile phone.

Step S512: and under the condition that a play switching instruction submitted for the play switching control is received, determining a system rendering layer corresponding to the target system.

Specifically, when the user presses the picture-in-picture button, it is determined that the rendering layer corresponding to the IOS system is the SBDL layer.

Step S514: the placeholder video is removed in a target window of the system rendering layer.

Specifically, the occupied video in the SBDL layer PIP floating window is removed.

Step S516: and switching the program rendering layer in the player carried by the client to the system rendering layer, and moving the target video from the program rendering layer to a target window of the system rendering layer.

Specifically, a program rendering layer in a player of the video APP is switched to SBDL, and the video is moved to a small window for playing.

Step S518: and reading the video attribute information, the barrage information and the display information of the target video according to the playing strategy of the system rendering layer.

Specifically, video attribute information, barrage information and display information in the target video display process are adjusted.

Step S520: and acquiring a playing strategy of the system rendering layer.

Step S522: and adjusting the playing priority of a target window of the system rendering layer according to the playing strategy of the system rendering layer, and playing the target video by adjusting the target window with the playing priority.

Specifically, the priority of the floating window of the picture in picture (SBDL) layer is set to be the highest, and the video played by the floating window of the picture in picture can be displayed at the uppermost layer of the mobile phone screen.

Step S524: and under the condition that a play conversion instruction submitted for the target system is received, moving the target video from a target window of the system rendering layer to the program rendering layer.

Specifically, after receiving the return instruction, the video is converted back to the rendering layer of the video APP.

Step S526: and playing the target video through the program rendering layer.

Specifically, a target video is played at a rendering layer of the video APP.

According to the video processing method, the target video is played through the program rendering layer of the video playing program; when a play switching instruction submitted by the video playing program is received, moving the target video from a target window of a program rendering layer to a system rendering layer corresponding to a target system, and playing the target video through the system rendering layer, so that the target video is not limited to the corresponding video playing program for video playing, the playing position and the playing form are flexibly switched, the video playing limitation is reduced, and the user experience is improved.

Corresponding to the above method embodiment, the present application further provides an embodiment of a video processing apparatus, and fig. 6 shows a schematic structural diagram of a video processing apparatus according to an embodiment of the present application. As shown in fig. 6, the apparatus includes:

A program rendering layer play module 602 configured to play a target video through a program rendering layer of the video play program;

a system rendering layer determining module 604 configured to determine a system rendering layer corresponding to the target system, in the case of receiving a play switching instruction submitted for the video play program;

and a program rendering layer moving module 606 configured to move the target video from the program rendering layer to a target window of the system rendering layer, and play the target video on the uppermost layer of the client display device through the target window, wherein the playing strategy of the system rendering layer is different from that of the program rendering layer, and the target window occupies a part of the display area of the display device.

In an alternative embodiment, the video processing apparatus further includes:

the creation module is configured to create the occupied video according to a preset occupied video rule; performing invisible playing on the occupying video on a target window of the system rendering layer; accordingly, the moving the target video from the program rendering layer to the target window of the system rendering layer includes: removing the occupied video in a target window of the system rendering layer; and moving the target video from the program rendering layer to a target window of the system rendering layer.

In an alternative embodiment, the creation module is further configured to:

In an alternative embodiment, the program rendering layer play module 602 is further configured to:

acquiring a play strategy of the program rendering layer; creating a play switching control according to a play strategy of the program rendering layer, playing the target video on the program rendering layer, and displaying the play switching control; correspondingly, under the condition that a play switching instruction submitted by the video play program is received, determining a system rendering layer corresponding to the target system comprises the following steps: and executing the step of determining the system rendering layer corresponding to the target system under the condition that a play switching instruction submitted by aiming at the play switching control is received.

acquiring a playing strategy of the system rendering layer; adjusting the playing priority of the system rendering layer according to the playing strategy of the target window of the system rendering layer, and playing the target video by adjusting the target window with the playing priority; and adjusting the target window with the playing priority to be finished at the uppermost layer of the client.

In an alternative embodiment, the system rendering layer determination module 604 is further configured to:

In an alternative embodiment, the program rendering layer movement module 606 is further configured to:

In an alternative embodiment, the video processing apparatus further includes:

a receiving module configured to move the target video from the system rendering layer to the program rendering layer upon receiving a play conversion instruction submitted for the target system; and playing the target video through a target window of the program rendering layer.

According to the video processing device, the target video is not limited to the corresponding video playing program for video playing, the playing position and the playing form are flexibly switched, the video playing limitation is reduced, and the user experience is improved.

Corresponding to the above method embodiment, the present application further provides an embodiment of a video processing apparatus, and fig. 7 shows a schematic structural diagram of another video processing apparatus according to an embodiment of the present application. As shown in fig. 7, the apparatus includes:

A system rendering layer playing module 702 configured to play the target video through a system rendering layer corresponding to the target system;

a program rendering layer determining module 704 configured to determine a program rendering layer of the video playing program in case of receiving a play conversion instruction submitted for the target system;

and a system rendering layer moving module 706, configured to move the target video from the system rendering layer to a target window of the program rendering layer, and play the target video on the uppermost layer of the client display device through the target window, where the playing policy of the system rendering layer is different from that of the program rendering layer, and the target window occupies a part of the display area of the display device.

According to the video processing device, the target video is played by converting the return sequence rendering layer from the system rendering layer, video playing limitation is reduced, and user experience is improved.

The above is a schematic solution of a video processing apparatus of the present embodiment. It should be noted that, the technical solution of the video processing apparatus and the technical solution of the video processing method belong to the same concept, and details of the technical solution of the video processing apparatus, which are not described in detail, can be referred to the description of the technical solution of the video processing method.

Fig. 8 illustrates a block diagram of a computing device 800 provided in accordance with an embodiment of the present application. The components of computing device 800 include, but are not limited to, memory 810 and processor 820. Processor 820 is coupled to memory 810 through bus 830 and database 850 is used to hold data.

Computing device 800 also includes access device 840, access device 840 enabling computing device 800 to communicate via one or more networks 860. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. Access device 840 may include one or more of any type of network interface, wired or wireless (e.g., a Network Interface Card (NIC)), such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.

In one embodiment of the present application, the above-described components of computing device 800, as well as other components not shown in FIG. 8, may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device illustrated in FIG. 8 is for exemplary purposes only and is not intended to limit the scope of the present application. Those skilled in the art may add or replace other components as desired.

Computing device 800 may be any type of stationary or mobile computing device including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), mobile phone (e.g., smart phone), wearable computing device (e.g., smart watch, smart glasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 800 may also be a mobile or stationary server.

Wherein processor 820 performs the steps of the video processing method when executing the instructions.

The foregoing is a schematic illustration of a computing device of this embodiment. It should be noted that, the technical solution of the computing device and the technical solution of the video processing method belong to the same concept, and details of the technical solution of the computing device, which are not described in detail, can be referred to the description of the technical solution of the video processing method.

An embodiment of the present application also provides a computer-readable storage medium storing computer instructions that, when executed by a processor, implement the steps of the video processing method as described above.

The above is an exemplary version of a computer-readable storage medium of the present embodiment. It should be noted that, the technical solution of the storage medium and the technical solution of the video processing method belong to the same concept, and details of the technical solution of the storage medium which are not described in detail can be referred to the description of the technical solution of the video processing method.

The foregoing describes specific embodiments of the present application. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

The computer instructions include computer program code that may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the computer readable medium contains content that can be appropriately scaled according to the requirements of jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is subject to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.

It should be noted that, for the sake of simplicity of description, the foregoing method embodiments are all expressed as a series of combinations of actions, but it should be understood by those skilled in the art that the present application is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily all necessary for the present application.

In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to the related descriptions of other embodiments.

The above-disclosed preferred embodiments of the present application are provided only as an aid to the elucidation of the present application. Alternative embodiments are not intended to be exhaustive or to limit the invention to the precise form disclosed. Obviously, many modifications and variations are possible in light of the teaching of this application. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best understand and utilize the invention. This application is to be limited only by the claims and the full scope and equivalents thereof.

Claims

1. A video processing method, applied to a client, the client running a target system and carrying a video playing program, the method comprising:

playing a target video through a program rendering layer of the video playing program, and playing a occupying video in a target window of a system rendering layer, wherein the occupying video is invisible to a user;

under the condition that a play switching instruction submitted by aiming at the video play program is received, determining a system rendering layer corresponding to the target system, and removing the occupied video in a target window of the system rendering layer;

2. The method of claim 1, wherein after the target video is played by the program rendering layer of the video playing program, further comprising:

And performing invisible playing on the occupying video in a target window of the system rendering layer.

3. The method of claim 2, wherein creating the placeholder video according to a preset placeholder video rule comprises:

4. The method of claim 2, wherein said performing non-visual playback of said placeholder video at said system rendering layer comprises:

and playing the target occupying video on the system rendering layer.

5. The method of claim 1, wherein the playing the target video by the program rendering layer of the video playing program comprises:

acquiring a play strategy of the program rendering layer;

6. The method of claim 1, wherein playing the target video at an uppermost layer of the client display device through the target window comprises:

acquiring a playing strategy of the system rendering layer;

7. The method of claim 1, wherein the receiving a play switch instruction submitted for the target video program comprises:

detecting a program state of the video playing program;

8. The method of claim 1, wherein the moving the target video from the program rendering layer to a target window of the system rendering layer and playing the target video at an uppermost layer of the client display device through the target window comprises:

9. The method of claim 8, wherein playing, by the player, the target video at an uppermost layer of the client display device, comprises:

10. The method of claim 1, wherein the playing the target video through the target window at an uppermost layer of the client display device further comprises:

and playing the target video through the program rendering layer.

11. A video processing method, applied to a client, the client running a target system and carrying a video playing program, the method comprising:

moving the target video from a target window of the system rendering layer to the program rendering layer, playing the target video through the program rendering layer, and playing a occupying video on the target window of the system rendering layer, wherein the occupying video is invisible to a user;

12. A video processing apparatus for application to a client running a target system and carrying a video playback program, the apparatus comprising:

the program rendering layer playing module is configured to play a target video through a program rendering layer of the video playing program, and play a space occupying video in a target window of the system rendering layer, wherein the space occupying video is invisible to a user;

the system rendering layer determining module is configured to determine a system rendering layer corresponding to the target system under the condition that a play switching instruction submitted by the video playing program is received, and remove the occupied video in a target window of the system rendering layer;

the program rendering layer moving module is configured to move the target video from the program rendering layer to a target window of the system rendering layer, and play the target video on the uppermost layer of the display device of the client through the target window, wherein the playing strategy of the system rendering layer is different from that of the program rendering layer, and the target window occupies part of the display area of the display device.

13. A video processing apparatus for application to a client running a target system and carrying a video playback program, the apparatus comprising:

the system rendering layer moving module is configured to move the target video from a target window of the system rendering layer to the program rendering layer, play the target video through the program rendering layer, and play the occupied video on the target window of the system rendering layer, wherein the occupied video is invisible to a user, the playing strategy of the system rendering layer is different from that of the program rendering layer, and the target window occupies part of the display area of the display device.

14. A computing device comprising a memory, a processor, and computer instructions stored on the memory and executable on the processor, wherein the processor, when executing the instructions, implements the steps of the method of any of claims 1-10 or 11.

15. A computer readable storage medium storing computer instructions which, when executed by a processor, implement the steps of the method of any one of claims 1-10 or 11.