CN114979748A

CN114979748A - Video processing method and device

Info

Publication number: CN114979748A
Application number: CN202210570972.9A
Authority: CN
Inventors: 黄凌初
Original assignee: Shanghai Bilibili Technology Co Ltd
Current assignee: Shanghai Bilibili Technology Co Ltd
Priority date: 2022-05-24
Filing date: 2022-05-24
Publication date: 2022-08-30
Anticipated expiration: 2042-05-24
Also published as: CN114979748B

Abstract

The application provides a video processing method and a video processing device, wherein the video playing comprises the following steps: playing a target video through a program rendering layer of the video playing program; determining a system rendering layer corresponding to the target system under the condition of receiving a play switching instruction submitted by aiming at the video playing program; moving the target video from the program rendering layer to a target window of the system rendering layer, and playing the target video on the uppermost layer of the client display device through the target window; the system rendering layer and the program rendering layer have different playing strategies, and the target window occupies part of the display area of the display device.

Description

Video processing method and device

Technical Field

The application relates to the technical field of videos, in particular to two video processing methods. The present application also relates to two video processing apparatuses, a computing device, and a computer-readable storage medium.

Background

With the development of internet technology and the popularization of mobile terminals, the proportion occupied by multimedia resources in the means for acquiring information by people is gradually increased, in the prior art, various video playing programs are generated in order to meet the increasing demand of people for acquiring multimedia resources, however, for the video playing program for realizing video resource playing, the application range of the video playing program is often limited due to the fact that the video playing program is designed only in consideration of the running condition of a special system environment, and the video playing program cannot play a role in any system environment, and even though a related running protocol is used, the video playing program can run in the corresponding system environment, but the video playing program cannot be completely adapted to the system environment, so that the functions cannot be completely developed, and the user experience is poor.

Disclosure of Invention

In view of this, the present application provides two video processing methods. The application relates to two video processing devices, a computing device and a computer readable storage medium, which are used for solving the problems that a video playing program in the prior art cannot run in partial system environment or partial functions cannot be developed during running, and the user experience is poor.

According to a first aspect of an embodiment of the present application, there is provided a video processing method applied to a client, where the client runs a target system and bears a video playing program, and the method includes:

playing a target video through a program rendering layer of the video playing program;

determining a system rendering layer corresponding to the target system under the condition of receiving a play switching instruction submitted by aiming at the video playing program;

moving the target video from the program rendering layer to a target window of the system rendering layer, and playing the target video on the uppermost layer of the client display device through the target window;

the system rendering layer and the program rendering layer have different playing strategies, and the target window occupies part of the display area of the display device.

Optionally, after the target video is played through the program rendering layer of the video playing program, the method further includes:

creating an occupancy video according to a preset occupancy video rule;

performing non-visual playing on the placeholder video in a target window of the system rendering layer;

correspondingly, the moving the target video from the program rendering layer to the target window of the system rendering layer comprises:

removing the placeholder video in a target window of the system rendering layer;

moving the target video from the program rendering layer to a target window of the system rendering layer.

Optionally, creating the placeholder video according to the preset placeholder video rule includes:

according to the occupancy video rule, an occupancy video which is in a mute state and is played circularly is constructed;

and the video frame of the occupancy video is a preset monochromatic video frame.

Optionally, the playing the placeholder video in the system rendering layer without visualization includes:

setting the sound state of the occupancy video to be a mute state, and setting the picture state of the occupancy video to be an invisible state to obtain a target occupancy video;

and playing the target occupancy video in the system rendering layer.

Optionally, the playing the target video through the program rendering layer of the video playing program includes:

acquiring a playing strategy of the program rendering layer;

creating a playing switching control according to the playing strategy of the program rendering layer, playing the target video on the program rendering layer, and displaying the playing switching control;

correspondingly, determining a system rendering layer corresponding to the target system when receiving a play switching instruction submitted by the video playing program includes:

and under the condition that a playing switching instruction submitted by aiming at the playing switching control is received, executing the step of determining the system rendering layer corresponding to the target system.

Optionally, the playing the target video on the uppermost layer of the client display device through the target window includes:

acquiring a playing strategy of the system rendering layer;

adjusting the playing priority of a target window of the system rendering layer according to the playing strategy of the system rendering layer, and playing the target video through the target window with the adjusted playing priority;

and the target window with the adjusted playing priority is arranged on the uppermost layer of the client.

Optionally, the receiving of the play switching instruction submitted by the target video program includes:

detecting the program state of the video playing program;

and generating the playing switching instruction according to the program quitting instruction under the condition that the program state is the playing switching state and the program quitting instruction is received.

Optionally, the moving the target video from the program rendering layer to a target window of the system rendering layer, and playing the target video on the uppermost layer of the client display device through the target window includes:

switching the program rendering layer in a player carried by the client to the system rendering layer, and moving the target video from the program rendering layer to a target window of the system rendering layer;

and playing the target video on the uppermost layer of the display equipment of the client through the player.

Optionally, the playing, by the player, the target video on the uppermost layer of the client display device includes:

reading video attribute information, barrage information and display information of the target video according to the playing strategy of the system rendering layer;

and configuring the video attribute information, the barrage information and the display information aiming at the player, and playing the target video on the uppermost layer of the display equipment of the client according to a configuration result.

Optionally, after the target video is played on the uppermost layer of the client display device through the target window, the method further includes:

in the case of receiving a play conversion instruction submitted for the target system, moving the target video from a target window of the system rendering layer to the program rendering layer;

and playing the target video through the program rendering layer.

According to a second aspect of the embodiments of the present application, there is provided another video processing method applied to a client, where the client runs a target system and carries a video playing program, and the method includes:

playing the target video through a system rendering layer corresponding to the target system;

determining a program rendering layer of the video playing program under the condition of receiving a playing conversion instruction submitted by aiming at the target system;

moving the target video from a target window of the system rendering layer to the program rendering layer, and playing the target video through the program rendering layer;

According to a third aspect of embodiments of the present application, there is provided a video processing apparatus including:

a program rendering layer playing module configured to play a target video through a program rendering layer of the video playing program;

the system rendering layer determining module is configured to determine a system rendering layer corresponding to the target system under the condition that a playing switching instruction submitted by aiming at the video playing program is received;

and the program rendering layer moving module is configured to move the target video from the program rendering layer to a target window of the system rendering layer, and play the target video on the uppermost layer of the client display device through the target window, wherein the system rendering layer and the program rendering layer have different playing strategies, and the target window occupies part of the display area of the display device.

According to a fourth aspect of the embodiments of the present application, there is provided another video processing apparatus including:

the system rendering layer playing module is configured to play the target video through a system rendering layer corresponding to the target system;

a program rendering layer determination module configured to determine a program rendering layer of the video playback program in a case where a playback conversion instruction submitted for the target system is received;

and the system rendering layer moving module is configured to move the target video from a target window of the system rendering layer to the program rendering layer, and play the target video through the program rendering layer, wherein the system rendering layer and the program rendering layer have different playing strategies, and the target window occupies part of the display area of the display device.

According to a fifth aspect of embodiments herein, there is provided a computing device comprising a memory, a processor and computer instructions stored on the memory and executable on the processor, the processor implementing the steps of the video processing method when executing the instructions.

According to a sixth aspect of embodiments herein, there is provided a computer readable storage medium storing computer instructions which, when executed by a processor, implement the steps of the video processing method.

According to the video processing method, the target video is played through the program rendering layer of the video playing program; determining a system rendering layer corresponding to the target system under the condition of receiving a play switching instruction submitted by aiming at the video playing program; moving the target video from the program rendering layer to a target window of the system rendering layer, and playing the target video on the uppermost layer of the client display device through the target window; the system rendering layer and the program rendering layer have different playing strategies, and the target window occupies part of the display area of the display device.

The embodiment of the application realizes that the target video is switched from the program rendering layer to the system rendering layer, the effect of video playing in any system is realized, the video playing is not limited to the corresponding video playing program, and because the video playing program is different from the target system in the playing strategy of the target video, the video playing process is carried out in the target window of the system rendering layer of the target system, the video playing is not only specified to be carried out on the uppermost layer of the client display equipment, but also the size range of the target window is specified, the video playing in the picture-in-picture window mode is realized, and the user experience is improved.

Drawings

Fig. 1 is a flowchart of a video processing method according to an embodiment of the present application;

fig. 2 is a flow chart of an automated video processing method according to an embodiment of the present application;

fig. 3 is a flowchart of a manual video processing method according to an embodiment of the present application;

fig. 4 is a flowchart of another video processing method according to an embodiment of the present application;

fig. 5 is a process flow diagram of a video processing method applied to pip according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of another video processing apparatus according to an embodiment of the present application;

fig. 8 is a block diagram of a computing device according to an embodiment of the present application.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit and scope of this application, and thus this application is not limited to the specific implementations disclosed below.

The terminology used in the one or more embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of the present application. As used in one or more embodiments of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present application refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It will be understood that, although the terms first, second, etc. may be used herein in one or more embodiments of the present application to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first aspect may be termed a second aspect, and, similarly, a second aspect may be termed a first aspect, without departing from the scope of one or more embodiments of the present application. The word "if," as used herein, may be interpreted as "at … …" or "when … …" or "in response to a determination," depending on the context.

First, the noun terms to which one or more embodiments of the present application relate are explained.

Picture in picture: a container provided by a mobile operating system and capable of playing videos outside applications.

Bgrender (hereinafter referred to as BGR): rendering layer of the ijkPlayer player.

AVSampleBufferDisplayLayer (hereinafter abbreviated as SBDL): a video rendering layer provided by a mobile operating system.

In the present application, two video processing methods are provided, and the present application relates to two video processing apparatuses, a computing device, and a computer-readable storage medium, which are described in detail one by one in the following embodiments.

Fig. 1 shows a flowchart of a video processing method according to an embodiment of the present application, which specifically includes the following steps:

step S102: and playing the target video through the program rendering layer of the video playing program.

The video processing method is applied to a client, an operating system corresponding to the client is a target system, and the client also bears a video playing program; the client can be understood as a device for playing the video by the user, including but not limited to a mobile phone, a computer, a tablet computer, a smart watch, and the like, which can play the video; the target system may be understood as an operating system running on the client, such as an Android system, an IOS system, or the like; the video playing program can be understood as software, a webpage, an APP and the like applied to video playing; the program rendering layer can be understood as a rendering layer which is established based on video playing software and is dedicated to the video playing program, is used for executing instructions issued by the video playing program, and renders related picture images in the target video playing process; the target video may be understood as a video being played in the video playing program, and then processed based on the received instruction.

Based on this, the video playing program in the client renders and plays the target video based on the program rendering layer corresponding to the video playing program. It should be noted that, for the specific display form of the target video in the program rendering layer, such as the picture scale, the related volume control, the definition control, and the like, how to set the target video is determined by the actual application scene, and this embodiment is not limited. In this way, the playing of the target video is achieved.

Further, under the condition that the target video is played, switching of the rendering layer of the target video is required to be realized subsequently, and on the premise, in order to improve user experience, a manual switching mode needs to be configured, so that switching of the rendering layer of the target video display by the user is ensured, in this embodiment, the specific implementation manner is as follows:

acquiring a playing strategy of the program rendering layer; creating a playing switching control according to the playing strategy of the program rendering layer, playing the target video on the program rendering layer, and displaying the playing switching control;

the playing strategy of the program rendering layer can be understood as a preset playing strategy, and the video played in the program rendering layer needs to comply with the strategy; the play switching control may be understood as a control for a user to manually switch a rendering layer of the target video play.

Based on the method, a playing strategy corresponding to the program rendering layer is obtained, then a switching control in a preset form is established according to the rules of the playing strategy, and when the program rendering layer plays the target video, the playing switching control is displayed in the program rendering layer at the same time.

For example, user a runs the C operating system on cell phone B, and B has installed video playback app D. For target video E1, play is performed on rendering layer BGR of app D of cell phone B. At this time, a playing strategy corresponding to the BGR is obtained, a playing switching control F is created based on the playing strategy corresponding to the BGR, and the F is displayed on the BGR.

In conclusion, the playing switching control is created, the requirement that a user manually switches the rendering layer of the target video playing can be met, and the user experience is enhanced.

Further, in a system rendering layer, a video playing task may be being executed, in this case, if a rendering layer of a target video playing is switched to the system rendering layer, a situation that switching cannot be performed due to the system rendering layer being occupied may occur, and in order to solve the problem, in this embodiment, a specific implementation manner is as follows:

creating an occupancy video according to a preset occupancy video rule; and carrying out non-visual playing on the occupancy video in a target window of the system rendering layer.

The occupied video can be understood as a video which is established for occupying a system rendering layer in advance in order to ensure that when a target video is switched to the system rendering layer for playing, the situation that the switching fails due to the playing tasks of other videos which are being executed does not occur; the placeholder video rule can be understood as a rule for specifying the form of the created placeholder video, wherein the placeholder video rule comprises sound information and video frame information of the placeholder video; the target window may be understood as a window for video playing, which exists in the system rendering layer and occupies a part of the client display device, and may move on the display device, where a part of the operation controls may be integrated, and the operation thereof by the user realizes the change of the video playing manner in the target window, such as the volume of the video, the playing speed, and the like, and the specific integrated control type and the number of controls are determined by the actual usage scenario, which is not limited in this embodiment.

Based on this, an occupancy video meeting a preset form is created through an occupancy video rule set in advance, and then the occupancy video is played in a target window of a system rendering layer, it should be noted that in order not to affect the playing of the target video in a program rendering layer, the occupancy video playing process is invisible to a user, and the invisible mode may be implemented by setting the transparency of the occupancy video itself to 100% or setting the playing priority of the target window to the lowest layer, so that a picture in the display device shields the target window, a specific invisible setting method is determined by an actual use scene, and this embodiment is not limited.

Following the above example, the placeholder video E2 is created by the preset placeholder video rule, and then the pip widget on the corresponding rendering layer SBDL of the operating system C is played, and because the playing priority of the pip widget at this time is set to the lowest layer, the pip widget is hidden under the desktop, so the playing process is not visible.

In conclusion, the occupied videos occupy the system rendering layer in advance, so that the situation that the playing tasks of other videos which are being executed occupy the system rendering layer to cause switching failure can be avoided when the target video is switched to the system rendering layer to be played.

Further, when the occupied video is played invisibly, the occupied video consumes the playing resources of the system, and in order to reduce consumption, in this embodiment, the specific implementation manner is as follows:

according to the occupancy video rule, an occupancy video which is in a mute state and is played circularly is constructed; the video frame of the placeholder video is a preset monochromatic video frame.

The sound state can be understood as an audio playing state in a video playing process, such as volume, stereo, and the like; the mute state may be understood as the volume of the video being 0; a monochrome video frame is understood to mean a video frame of only one color.

Based on the space occupying video rule, a space occupying video with the volume of 0 and only one pure-color video frame for circular playing is created.

Following the above example, with the occupancy video rule, the occupancy video E2 is created with volume 0 and a pure black video frame playing in a loop.

In conclusion, the created occupancy video cannot influence related content being played at the client side acoustically, and the video frame played in a monochrome loop mode also greatly reduces the playing resource consumption of the video. It should be noted that, in this case, in order to ensure that the playing picture of the target video is not affected by the bit video, the color of the monochrome video frame may be set to be colorless at this time.

Further, except that the color of the monochrome video frame of the placeholder video is set to be colorless, the display picture of the target video can not be affected by the placeholder video by setting the picture state in the placeholder video display process, and in the embodiment, the specific implementation mode is as follows:

setting the sound state of the occupancy video to be a mute state, and setting the picture state of the occupancy video to be an invisible state to obtain a target occupancy video; and playing the target occupancy video in the system rendering layer.

The target occupancy video can be understood as the occupancy video set by the picture state.

Based on this, in order to ensure that the played sound of the target video is not affected by the occupied video, the sound of the occupied video is set to 0, and then the picture state of the occupied video is set to the invisible state, it should be noted that the invisible state only needs to ensure that the occupied video cannot be observed by the user, and no matter the picture on the current client display screen is captured as the picture of the occupied video, or the transparency of each video frame in the occupied video is set to 100%, or the target window playing the occupied video is placed at the lowest layer of the client display device and is blocked by other pictures displayed by the client display device, the method for setting the invisible state is adopted, which mode is determined by the actual application scene specifically, and the embodiment is not limited. And then playing the occupancy video in a system rendering layer.

Following the above example, the volume of the placeholder video E2 is set to 0, then its transparency is set to 100%, and then played via the set picture-in-picture small window of E2 on the SBDL.

In summary, by the above method, the form of the placeholder video does not need to be limited, any volume can be achieved, the placeholder video of any picture can be realized by the setting mode, playing on the system rendering layer does not affect the playing of the target video, and it should be noted that, in order to save the consumption of playing resources, the placeholder video is preferably a video that cyclically plays monochrome video frames.

Step S104: and under the condition that a playing switching instruction submitted by aiming at the video playing program is received, determining a system rendering layer corresponding to the target system.

Specifically, after the program rendering layer shows the target video, if a play switching instruction is received, the rendering layer for playing the target video needs to be replaced.

The playing switching instruction can be understood as an instruction for indicating that the target video needs to be switched to play the rendering layer; the system rendering layer may be understood as a rendering layer which is established based on the target system and is dedicated to the target system, and is used for executing an instruction issued by the target system at the client, so as to render the video image in the process of playing the related video in the picture-in-picture window.

Based on the instruction, which is submitted by the video playing program and indicates that the target video needs to be switched to the rendering layer for playing, when the instruction is received by the client, the system rendering layer corresponding to the target system is determined; by determining the system rendering layer, the rendering layer to which the target video needs to be switched is also determined.

Further, in a scenario, it may be specified that when the user exits the video playing program, the rendering layer of the target video is automatically switched, and in this embodiment, the specific implementation manner is as follows:

detecting the program state of the video playing program; and generating the playing switching instruction according to the program quitting instruction under the condition that the program state is the playing switching state and the program quitting instruction is received.

The program state can be understood as indicating whether a video playing program starts a function of automatically switching a rendering layer for a target video; the playing switching state can be understood as that the video playing program starts the function of automatically switching the rendering layer for the target video; the exit instruction can be understood as an instruction indicating that the user exits from the video playing program to play the target video, for example, when the mobile phone watches the video, the video exiting from the playing returns to the video list page, or exits from the video playing program and returns to the desktop of the mobile phone, and the like.

Based on the method, whether the function of automatically switching the rendering layer for the target video is started by the video playing program is detected, and if the function of automatically switching the rendering layer for the target video is started by the video playing program and a program exit instruction is received, a playing switching instruction is generated.

In the above example, the program state of app D is detected, and when the program state is detected to be the playback switching state, the playback switching instruction G2 is generated according to the exit instruction after the instruction G1 to exit the playback window of the target video E1 is received.

In conclusion, in this way, when the preset trigger condition is met, the play switching instruction is generated to instruct the rendering layer switching of the next target video.

Further, there is a manual triggering manner besides the process of automatically triggering the switching of the rendering layer of the target video, and in this embodiment, the specific implementation manner is as follows:

And the subsequent step of switching the rendering layer of the target video is executed after the play switching control created in the step receives the play switching instruction submitted aiming at the play switching non-space.

In the above example, after receiving the click control F from the user a, the step of determining the system rendering layer corresponding to the target system is executed.

In summary, besides the switching of the rendering layer of the target video is automatically triggered, a manual triggering mode exists, the control of the user on the switching of the rendering layer of the target video is improved, and the operability is improved.

Step S106: and moving the target video from the program rendering layer to a target window of the system rendering layer, and playing the target video on the uppermost layer of the client display equipment through the target window.

Specifically, after a play switching instruction is received and a system rendering layer is determined, the rendering layer of the target video needs to be switched, and the target video is displayed based on the switched rendering layer.

The playing policy may be understood as a policy that can affect a video playing presentation effect, such as a size, a position, and a sound channel of a playing interface, and the video information specifically included in the playing policy is determined by an actual usage scenario, which is not limited in this embodiment.

Based on the above, the target video is moved from the program rendering layer to the target window of the system rendering layer, and then the target video is played according to a playing strategy of the system rendering layer different from the program rendering layer, in the process, the target video is displayed in the target window, and the target window is displayed on the uppermost layer of the display device of the client, that is, in the process of displaying the target video in the target window, the picture of the target video is displayed in the display device of the client at the highest priority, and other pictures in the display device cannot shield the target window displaying the target video; when the target window is displayed in the display device, the display area of the display device may not be occupied, but only a part of the area is occupied, and the size of the occupied area may be adjusted by the user, and the specific size is determined by the actual use scene, which is not limited in this embodiment. In addition, in the process of displaying the target video in the target window, because the target window exists in the system rendering layer, the target window needs to comply with the playing policy of the system rendering layer for displaying the target video, it should be noted that there is no connection between the playing rules of the system rendering layer and the program rendering layer, at this time, the setting of the playing rule of the system rendering layer may be consistent with the playing rule of the program rendering layer, or may be different, the specific set parameter is determined by the actual usage scenario, and this embodiment is not limited.

Further, if there is a placeholder video in the system rendering layer, in this embodiment, the specific implementation manner is as follows:

removing the placeholder video in a target window of the system rendering layer; moving the target video from the program rendering layer to the system rendering layer.

And removing the position occupying video existing in the system rendering layer, and then moving the target video from the program rendering layer to the system rendering layer. It should be noted that when the target video is moved from the program rendering layer to the system rendering layer, the target video may be selected to be removed from the program rendering layer, or the sound of the target video may be set to be in a mute state and the picture may be set to be in an invisible state like the placeholder video, and which manner is specifically selected is determined by an actual usage scene, which is not limited in this embodiment.

Following the above example, E2 is removed in the SBDL's picture-in-picture small window, followed by E1 in the BGR and E1 is moved to the SBDL's picture-in-picture small window.

In conclusion, the occupied videos can occupy the system rendering layer all the time, other videos cannot be played on the system rendering layer, and the situation that the target videos cannot be switched due to the fact that the system rendering layer is occupied when the target videos are switched is guaranteed. The smoothness and smoothness of switching are ensured.

Further, when there is a picture that is played and can be displayed between the two rendering layers, the system rendering layer and the program rendering layer may be shielded by the program rendering layer, and in order to solve the problem, in this embodiment, a specific implementation manner is as follows:

acquiring a playing strategy of the system rendering layer; adjusting the playing priority of a target window of the system rendering layer according to the playing strategy of the system rendering layer, and playing the target video through the target window with the adjusted playing priority; and the target window with the adjusted playing priority is arranged on the uppermost layer of the client.

The play priority may be understood as indicating a position relationship between the system rendering layer and the program rendering layer, and when the rendering layer with a high play priority plays the video, the rendering layer with a low play priority may be on the upper layer.

Based on the method, the system rendering layer is inquired to obtain the playing strategy corresponding to the system rendering layer, then the playing priority of the system rendering layer is adjusted according to the playing strategy of the system rendering layer, and therefore the relation between the target video played on the system rendering layer and the system rendering layer displaying the video playing program interface is determined. It should be noted that the picture displayed in the system rendering layer may be overlaid on the picture displayed in the program rendering layer.

The SBDL playing strategy is obtained along the above example, then the playing priority of the SBDL picture-in-picture small window is adjusted based on the adjustment, so that the lowest playing priority of the SBDL picture-in-picture small window originally playing E2 is adjusted to be the highest, and then the E1 can be played on the uppermost layer of the mobile phone based on the SBDL picture-in-picture small window.

In conclusion, by setting the playing priority, the playing order is ensured, and the target video played in the system rendering layer is not blocked.

Further, switching the rendering layer of the target video is actually a process of switching the rendering layer by a player playing the target video, and in this embodiment, the specific implementation manner is as follows:

switching the program rendering layer in a player carried by the client to the system rendering layer, and moving the target video from the program rendering layer to a target window of the system rendering layer; and playing the target video on the uppermost layer of the display equipment of the client through the player.

It should be noted that, in this embodiment, the player playing the target video is embedded in the video playing program, and the player playing the occupied video is the content in the target system.

Based on the above, the player embedded in the video playing program switches the program rendering layer into the system rendering layer, and then the target video is rendered in the system rendering layer by the player in a related surface changing manner and played by the related audio, so that the target video is played in the system rendering layer.

Along the above example, app D uses the supporting player ijkplay to switch the rendering layer to which ijkplay faces from BGR to SBDL, and then the ijkplay plays E1 on the picture-in-picture widget of SBDL; when E2 is played on SBDL, the player AVPlayer associated with the operating system C plays E2 through the picture-in-picture window.

In conclusion, the player realizes the switching of the rendering layers, so that the operability is improved, the development and implementation of related equipment, software and the like of the video processing method are facilitated, and the development cost is saved.

Further, in the process of playing the target video by the system rendering layer, if the playing form is consistent with that of the target video in the program rendering layer, the switching is meaningless for the user, and in order to solve the problem, in this embodiment, the specific implementation manner is as follows:

reading video attribute information, barrage information and display information of the target video according to the playing strategy of the system rendering layer; and configuring the video attribute information, the barrage information and the display information aiming at the player, and playing the target video on the uppermost layer of the display equipment of the client according to a configuration result.

The video attribute information can be understood as information about the volume, the picture size, the horizontal and vertical proportion, the definition and the like of the video; the bullet screen information can be understood as information about whether the bullet screen of the video is displayed, fonts, anti-blocking and the like; the display information can be understood as information about the shape of a display window, the position of the display window and the like of the video; it should be noted that the information included in the video attribute information, the barrage information, and the presentation information is not fixed, and what information is specifically included is determined by the actual application scenario, which is not limited in this embodiment.

Following the above example, the video attribute information, the barrage information, and the presentation information of E1 are read according to the play strategy of SBDL, and it is determined according to the reading result that E1 adopts 1080P definition during the play, does not display the barrage, and presents in a floating window manner with a size of 4cm:3cm, and then ijkPlayer presents E1 in the small window of picture-in-picture of SBDL based on these requirements.

In summary, various extended functions can be realized by the above method, such as picture-in-picture playing of the target video is realized in the example. It should be noted that there is more than one extension function implemented based on the configuration of the video attribute information, the bullet screen information, and the presentation information, and how to implement the extension function based on different configurations is determined by the actual application scenario, and this implementation is not limited.

Further, in addition to switching the rendering layer of the target video from the program rendering layer to the system rendering layer, the system rendering layer may be reversely converted back to the program rendering layer, and in this embodiment, the specific implementation manner is as follows:

in the case of receiving a play conversion instruction submitted for the target system, moving the target video from a target window of the system rendering layer to the program rendering layer; and playing the target video through the program rendering layer.

The playback switching instruction may be understood as an instruction similar to the playback switching instruction, but for instructing the rendering layer to switch from the system rendering layer to the back-order rendering layer.

Based on this, the process of converting the rendering layer from the system rendering layer to the instruction of the return sequence rendering layer is similar to the process of switching the rendering layer from the program rendering layer to the system rendering layer, and is not described herein again.

In conclusion, the rendering layer of the target video is switched from the rendering layer to the system rendering layer, the return sequence rendering layer is switched, the flexibility of switching the rendering layer of the target video is guaranteed, and the user experience is improved.

According to the video processing method, the target video is played through the program rendering layer of the video playing program; when a playing switching instruction submitted by aiming at the video playing program is received, the target video is moved from the program rendering layer to a target window of a system rendering layer corresponding to the target system, and the playing target video is played on the uppermost layer of the client display equipment, so that the target video is not limited to the corresponding video playing program to play the video, the playing position and the playing form are flexibly switched, the video playing limitation is reduced, and the user experience is improved.

According to a flow chart of an automated video processing method provided by an embodiment of the present application shown in fig. 2, a flow chart of a video processing method performed by a system of an IOS 15 and above is disclosed; in this flow, the target video is played at the beginning, such as "the user enters playing above IOS 15 and also starts playing" in the figure; then, creating an occupancy video and playing the occupancy video in a system rendering layer, for example, creating an AVplayer to play a static silent video in a circulating mode; then, the placeholder video is played in a system rendering layer until an exit instruction appears, such as 'adding the AVplayer into a view level and hosting the AVplayer to a picture-in-picture' and 'waiting for the system to enter a background to automatically call up the picture-in-picture'; normally quitting under the condition that the program state is not the play switching state, such as 'quitting picture-in-picture flow and clearing data' in the figure; under the condition that the program state is the play switching state, judging that the current program state is AVSampleBufferDisplayLayer as shown in the figure, and then switching rendering layers according to a judgment result, wherein the switching rendering layers are equivalent to the rendering layers where the target videos are located; and then playing the target video according to the system rendering layer, such as "acquire current AVSampleBufferDisplayLayer", "host AVSampleBufferDisplayLayer to the picture-in-picture play source", and "switch the picture-in-picture play source to the current player, and exit the play page by app" in the figure.

Fig. 3 is a flowchart of a manual video processing method according to an embodiment of the present disclosure, where a play switching instruction obtained based on a play switching control is received, such as "clicking a picture-in-picture button" in the drawing; the process of determining the rendering layer where the target video is located is followed by the similar determination process, for example, as shown in "the current rendering layer is AVSampleBufferDisplayLayer"; the content in the subsequent figure is similar to the content of the above-mentioned automation part, and the target video is also played according to the system rendering layer, which is not described herein again.

Fig. 4 is a flowchart illustrating another video processing method according to an embodiment of the present application, which specifically includes the following steps:

step S402: and playing the target video through a system rendering layer corresponding to the target system.

Step S404: and determining a program rendering layer of the video playing program under the condition of receiving a playing conversion instruction submitted by the target system.

Step S406: and moving the target video from a target window of the system rendering layer to the program rendering layer, and playing the target video through the program rendering layer.

Specifically, when a target video is played in a system rendering layer of a target system, that is, when the target video is displayed in a target window of the system rendering layer, if a play conversion instruction is received, it is indicated that a user needs to convert the target video, which is originally displayed in the target window, to be displayed in a program rendering layer, in this case, first, a program rendering layer to which the target video needs to be converted is determined, then, the target video is extracted from the target window of the system rendering layer, the target video is moved to the program rendering layer, the target video is displayed by the program rendering layer, at this time, the display of the target video needs to comply with a play policy of the program rendering layer, that is, the target video is played according to a video play rule of the program rendering layer, it is indicated that the formulation of the play policy of the program rendering layer is determined by an actual use scene, that is, the present embodiment does not limit the setting of the parameters therein. In addition, the target window of the system rendering layer is the same as the target window of the system rendering layer in the video processing method related in this specification, and details are not repeated here in this embodiment.

It should be noted that, the video processing method for converting the rendering layer from the system rendering layer to the return sequence rendering layer is similar to the video processing method for switching the rendering layer from the program rendering layer to the system rendering layer in the execution process, and details are not repeated here.

According to the other video processing method provided by the application, a target video is played through a system rendering layer of a target system; when a play switching instruction submitted by the target system is received, the target video is moved from a target window of a program rendering layer to the program rendering layer corresponding to the video playing program, and the target video is played through the program rendering layer, so that the target video is converted from the system rendering layer to a return sequence rendering layer for playing, the video playing limitation is reduced, and the user experience is improved.

The following description will further describe the video processing method provided in the present application with reference to fig. 5 by taking the application of the video processing method in pip as an example. Fig. 5 shows a processing flow chart of a video processing method applied to a picture-in-picture according to an embodiment of the present application, which specifically includes the following steps:

step S502: and acquiring a playing strategy of the program rendering layer.

Specifically, under the condition that a user watches videos by using an IOS mobile phone, a video playing program is cut out through a picture-in-picture button, and under the condition of generating a picture-in-picture floating window, a playing strategy of a rendering layer corresponding to a video APP is obtained firstly.

Step S504: and creating a playing switching control according to the playing strategy of the program rendering layer, playing the target video on the program rendering layer, and displaying the playing switching control.

Specifically, a picture-in-picture key is created according to a playing strategy of a rendering layer corresponding to the video APP, and then the picture-in-picture key is added to the rendering layer corresponding to the video APP, and the target video is played on the rendering layer.

Step S506: and constructing the occupied video with a sound state being a mute state and being played circularly according to the occupied video rule.

Specifically, the placeholder video is created according to the placeholder video rule, wherein the placeholder video is silent, and the video of the monochrome video frame is played in a circulating mode.

Step S508: and setting the picture state of the occupancy video to be an invisible state to obtain the target occupancy video.

Specifically, the transparency of the occupancy video is adjusted to 100%.

Step S510: and playing the target occupancy video in a target window of the system rendering layer.

Specifically, the picture-in-picture floating window display on the SBDL layer of the IOS system of the mobile phone.

Step S512: and under the condition that a playing switching instruction submitted aiming at the playing switching control is received, determining a system rendering layer corresponding to the target system.

Specifically, when the user presses the pip key, the rendering layer corresponding to the IOS system is determined to be the SBDL layer.

Step S514: removing the placeholder video in a target window of the system rendering layer.

Specifically, the placeholder video in the SBDL layer picture-in-picture floating window is removed.

Step S516: and switching the program rendering layer in a player carried by the client to the system rendering layer, and moving the target video from the program rendering layer to a target window of the system rendering layer.

Specifically, a program rendering layer in a player of the video APP is switched to the SBDL, and the video is moved to a small window for playing.

Step S518: and reading the video attribute information, the barrage information and the display information of the target video according to the playing strategy of the system rendering layer.

Specifically, video attribute information, barrage information and display information in the target video display process are adjusted.

Step S520: and acquiring a playing strategy of the system rendering layer.

Step S522: and adjusting the playing priority of a target window of the system rendering layer according to the playing strategy of the system rendering layer, and playing the target video through the target window with the adjusted playing priority.

Specifically, the priority of the picture-in-picture floating window on the SBDL layer is set to be the highest, and a video played on the picture-in-picture floating window can be displayed on the uppermost layer of the mobile phone screen.

Step S524: moving the target video from a target window of the system rendering layer to the program rendering layer upon receiving a play conversion instruction submitted for the target system.

Specifically, after receiving the return instruction, the video is converted back to the rendering layer of the video APP.

Step S526: and playing the target video through the program rendering layer.

Specifically, the target video is played on a rendering layer of the video APP.

According to the video processing method, the target video is played through the program rendering layer of the video playing program; when a play switching instruction submitted by the video playing program is received, the target video is moved to a system rendering layer corresponding to the target system from a target window of the program rendering layer, and the target video is played through the system rendering layer, so that the target video is not limited to the corresponding video playing program to play the video, the playing position and the playing form are flexibly switched, the video playing limitation is reduced, and the user experience is improved.

Corresponding to the above method embodiment, the present application further provides an embodiment of a video processing apparatus, and fig. 6 shows a schematic structural diagram of a video processing apparatus provided in an embodiment of the present application. As shown in fig. 6, the apparatus includes:

a program rendering layer playing module 602 configured to play the target video through a program rendering layer of the video playing program;

a system rendering layer determining module 604, configured to determine a system rendering layer corresponding to the target system when a playback switching instruction submitted by the video playback program is received;

a program rendering layer moving module 606 configured to move the target video from the program rendering layer to a target window of the system rendering layer, and play the target video on the top layer of the client display device through the target window, wherein the system rendering layer and the program rendering layer have different playing strategies, and the target window occupies a part of the display area of the display device.

In an optional embodiment, the video processing apparatus further comprises:

the creating module is configured to create an occupancy video according to a preset occupancy video rule; playing the placeholder video in a target window of the system rendering layer in an invisible mode; correspondingly, the moving the target video from the program rendering layer to the target window of the system rendering layer comprises: removing the placeholder video in a target window of the system rendering layer; moving the target video from the program rendering layer to a target window of the system rendering layer.

In an optional embodiment, the creation module is further configured to:

In an alternative embodiment, the program rendering layer playing module 602 is further configured to:

acquiring a playing strategy of the program rendering layer; creating a playing switching control according to the playing strategy of the program rendering layer, playing the target video on the program rendering layer, and displaying the playing switching control; correspondingly, determining a system rendering layer corresponding to the target system when receiving a play switching instruction submitted by the video playing program includes: and under the condition that a playing switching instruction submitted by aiming at the playing switching control is received, executing the step of determining the system rendering layer corresponding to the target system.

acquiring a playing strategy of the system rendering layer; adjusting the playing priority of the system rendering layer according to the playing strategy of the target window of the system rendering layer, and playing the target video through the target window with the adjusted playing priority; and the target window with the adjusted playing priority is arranged on the uppermost layer of the client.

In an optional embodiment, the system rendering layer determination module 604 is further configured to:

In an alternative embodiment, the program rendering layer moving module 606 is further configured to:

In an optional embodiment, the video processing apparatus further comprises:

a receiving module configured to move the target video from the system rendering layer to the program rendering layer upon receiving a play conversion instruction submitted for the target system; and playing the target video through a target window of the program rendering layer.

The application provides a video processing device, make the target video realize not being restricted to corresponding video broadcast procedure and carry out the video broadcast to nimble switching broadcast position and broadcast form reduce the video broadcast limitation, promote user experience.

Corresponding to the above method embodiment, the present application further provides an embodiment of a video processing apparatus, and fig. 7 shows a schematic structural diagram of another video processing apparatus provided in an embodiment of the present application. As shown in fig. 7, the apparatus includes:

a system rendering layer playing module 702 configured to play the target video through a system rendering layer corresponding to the target system;

a program rendering layer determining module 704 configured to determine a program rendering layer of the video playing program in a case where a play conversion instruction submitted for the target system is received;

a system rendering layer moving module 706 configured to move the target video from the system rendering layer to a target window of the program rendering layer, and play the target video on the top layer of the client display device through the target window, wherein the system rendering layer and the program rendering layer have different playing strategies, and the target window occupies a part of a display area of the display device.

According to the other video processing device, the target video is played from the system rendering layer to the return sequence rendering layer, the video playing limitation is reduced, and the user experience is improved.

The above is a schematic scheme of a video processing apparatus of the present embodiment. It should be noted that the technical solution of the video processing apparatus belongs to the same concept as the technical solution of the video processing method, and details that are not described in detail in the technical solution of the video processing apparatus can be referred to the description of the technical solution of the video processing method.

Fig. 8 illustrates a block diagram of a computing device 800 provided according to an embodiment of the present application. The components of the computing device 800 include, but are not limited to, memory 810 and a processor 820. The processor 820 is coupled to the memory 810 via a bus 830, and the database 850 is used to store data.

Computing device 800 also includes access device 840, access device 840 enabling computing device 800 to communicate via one or more networks 860. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. Access device 840 may include one or more of any type of network interface (e.g., a Network Interface Card (NIC)) whether wired or wireless, such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.

In one embodiment of the application, the above-described components of the computing device 800 and other components not shown in fig. 8 may also be connected to each other, for example, by a bus. It should be understood that the block diagram of the computing device structure shown in FIG. 8 is for purposes of example only and is not limiting as to the scope of the present application. Those skilled in the art may add or replace other components as desired.

Computing device 800 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), a mobile phone (e.g., smartphone), a wearable computing device (e.g., smartwatch, smartglasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 800 may also be a mobile or stationary server.

Wherein the processor 820 implements the steps of the video processing method when executing the instructions.

The above is an illustrative scheme of a computing device of the present embodiment. It should be noted that the technical solution of the computing device and the technical solution of the video processing method belong to the same concept, and details that are not described in detail in the technical solution of the computing device can be referred to the description of the technical solution of the video processing method.

An embodiment of the present application further provides a computer-readable storage medium, which stores computer instructions, when executed by a processor, for implementing the steps of the video processing method as described above.

The above is an illustrative scheme of a computer-readable storage medium of the present embodiment. It should be noted that the technical solution of the storage medium belongs to the same concept as the technical solution of the above-mentioned video processing method, and details that are not described in detail in the technical solution of the storage medium can be referred to the description of the technical solution of the above-mentioned video processing method.

The foregoing description of specific embodiments of the present application has been presented. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

The computer instructions comprise computer program code which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.

It should be noted that, for the sake of simplicity, the above-mentioned method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

The preferred embodiments of the present application disclosed above are intended only to aid in the explanation of the application. Alternative embodiments are not exhaustive and do not limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the application and its practical applications, to thereby enable others skilled in the art to best understand and utilize the application. The application is limited only by the claims and their full scope and equivalents.

Claims

1. A video processing method is applied to a client, wherein the client runs a target system and bears a video playing program, and the method comprises the following steps:

2. The method of claim 1, wherein after playing the target video through the program rendering layer of the video playing program, further comprising:

creating an occupancy video according to a preset occupancy video rule;

playing the placeholder video in a target window of the system rendering layer in an invisible mode;

3. The method of claim 2, wherein creating the placeholder video according to the preset placeholder video rule comprises:

4. The method of claim 2, wherein the playing the placeholder video in the system rendering layer without visualization comprises:

setting the sound state of the occupancy video to be a mute state, and setting the picture state of the occupancy video to be an invisible state, so as to obtain a target occupancy video;

and playing the target occupancy video in the system rendering layer.

5. The method of claim 1, wherein playing the target video through the program rendering layer of the video playing program comprises:

acquiring a playing strategy of the program rendering layer;

6. The method of claim 1, wherein the playing the target video through the target window at a top-most layer of the client display device comprises:

acquiring a playing strategy of the system rendering layer;

7. The method of claim 1, wherein receiving a playback switching instruction submitted for the target video program comprises:

detecting the program state of the video playing program;

and under the condition that the program state is a playing switching state and a program exit instruction is received, generating the playing switching instruction according to the program exit instruction.

8. The method of claim 1, wherein moving the target video from the program rendering layer to a target window of the system rendering layer and playing the target video through the target window at a top layer of the client display device comprises:

9. The method of claim 8, wherein playing, by the player, the target video at a top-level of the client display device comprises:

10. The method of claim 1, wherein after the target video is played at a top-level of the client display device through the target window, further comprising:

and playing the target video through the program rendering layer.

11. A video processing method is applied to a client, the client runs a target system and bears a video playing program, and the method comprises the following steps:

12. A video processing apparatus applied to a client, the client running a target system and carrying a video playing program, the apparatus comprising:

and the program rendering layer moving module is configured to move the target video from the program rendering layer to a target window of the system rendering layer, and play the target video on the uppermost layer of the display device of the client through the target window, wherein the system rendering layer and the program rendering layer have different playing strategies, and the target window occupies part of the display area of the display device.

13. A video processing apparatus applied to a client, the client running a target system and carrying a video playing program, the apparatus comprising:

14. A computing device comprising a memory, a processor and computer instructions stored on the memory and executable on the processor, wherein the processor implements the steps of the method of any one of claims 1-10 or 11 when executing the instructions.

15. A computer-readable storage medium storing computer instructions, which when executed by a processor, perform the steps of the method of any one of claims 1 to 10 or 11.