CN114125341A

CN114125341A - Video processing method, video processing device, electronic equipment, storage medium and product

Info

Publication number: CN114125341A
Application number: CN202111280677.1A
Authority: CN
Inventors: 武文杰; 尹珊
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2021-10-29
Filing date: 2021-10-29
Publication date: 2022-03-01
Anticipated expiration: 2041-10-29
Also published as: CN114125341B

Abstract

The present disclosure relates to a video processing method, apparatus, electronic device, storage medium and product, the method comprising: sending a video recording request to a first server; receiving a recording start identifier corresponding to a start video frame of a service recording video sent by a first server; in the process of executing the target cloud service by the target user account, according to the recording start identifier, carrying out audio acquisition from the moment corresponding to the start video frame to obtain a service recording audio; sending a service recording audio to a second server; and receiving recording completion information corresponding to the recorded synthetic video sent by the second server. By the aid of the method and the device, the problems that the quality of the recorded cloud application video is low, time delay exists between audio and pictures, terminal computing resources are occupied, and terminal blocking is easily caused can be solved.

Description

Video processing method, video processing device, electronic equipment, storage medium and product

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a video processing method and apparatus, an electronic device, a storage medium, and a product.

Background

With the rapid development of computer technology, cloud applications occupy more and more important positions. The cloud application refers to an application in which application logic runs in a server, and a user only needs to own a basic client, and the client only needs to receive and play corresponding audio and video streams and send operation data of the user to the server, so that a cloud task can be executed in the cloud application.

In the related art, if a user wants to record or share the execution process in the process of executing the cloud service by the cloud application, a video recording tool needs to be downloaded to record a video generated in the process of executing the cloud service separately. However, the cloud application picture may change along with fluctuation of the network condition, which may cause low quality of the recorded cloud application video in the related art, delay between the audio and the picture, and occupation of terminal computing resources, which may easily cause terminal blocking.

Disclosure of Invention

The disclosure provides a video processing method, a video processing device, an electronic device, a storage medium and a product, which are used for at least solving the problems that the quality of a recorded cloud application video is low, time delay exists between an audio frequency and a picture, terminal computing resources are occupied, and terminal blocking is easily caused in the related art. The technical scheme of the disclosure is as follows:

according to a first aspect of the embodiments of the present disclosure, there is provided a video processing method, including:

sending a video recording request to a first server, wherein the video recording request is used for indicating the first server to record a service execution video generated in the process of executing a target cloud service by a target user account to obtain a service recording video;

receiving a recording start identifier corresponding to a start video frame of the service recording video sent by the first server;

in the process of executing the target cloud service by the target user account, according to the recording starting identifier, carrying out audio acquisition from the moment corresponding to the starting video frame to obtain a service recording audio;

sending the service recording audio to a second server;

and receiving recording completion information corresponding to the recorded synthetic video sent by the second server, wherein the recorded synthetic video is a video obtained by synthesizing the service recorded video and the service recorded audio.

In one possible design, the request to record a video includes an identifier of a single recording, and before sending the request to record a video to the first server, the method further includes:

in the process of executing the target cloud service by the target user account, if a video recording instruction is detected, generating the single recording identifier;

and generating the video recording request based on the single recording identification.

In a possible design, in the process of executing the target cloud service by the target user account, according to the recording start identifier, performing audio acquisition from a time corresponding to the start video frame to obtain a service recording audio, where the method includes:

and in the process of executing the target cloud service by the target user account, according to the single recording identifier and the recording starting identifier, carrying out audio acquisition from the moment corresponding to the starting video frame to obtain a service recording audio corresponding to the single recording identifier.

In one possible design, the sending the service recording audio to the second server includes:

and sending the service recording audio and the single recording identifier to the second server, wherein the single recording identifier is used for indicating the second server to determine a service recording video corresponding to the service recording audio.

In a possible design, before generating the single recording identifier if the video recording command is detected, the method further includes:

and in the process of executing the target cloud service by the target user account, if the execution operation is detected to be a preset recording operation, generating the video recording instruction.

and in the process of executing the target cloud service by the target user account, generating the video recording instruction under the condition of detecting that the target cloud service reaches the target progress.

In one possible design, the method further includes:

responding to a recorded video sharing instruction, and sending a video sharing request to the second server, wherein the video sharing request comprises sharing position information, and the sharing position information is used for indicating the second server to send the recorded composite video to a target sharing position corresponding to the sharing position information;

and receiving video sharing success prompt information sent by the second server.

According to a second aspect of the embodiments of the present disclosure, there is provided a video processing method, including:

receiving a video recording request sent by a terminal;

determining a recording start identifier corresponding to a start video frame of video recording, wherein the recording start identifier is used for indicating a terminal to acquire audio from the moment corresponding to the start video frame in the process of executing the target cloud service by the target user account, so as to obtain service recording audio;

recording a service execution video generated in the process of executing the target cloud service by the target user account from the initial video frame to obtain a service recording video;

sending the recording starting identifier to the terminal;

sending the service recorded video to a second server;

and the service recorded video and the service recorded audio are used for synthesizing and recording a synthesized video.

In one possible design, the recording the video request includes a single recording identifier, the service recorded video is a recorded video corresponding to the single recording identifier, and the sending the service recorded video to the second server includes:

and sending the service recording video and the single recording identifier to the second server, wherein the single recording identifier is used for indicating the second server to determine the service recording audio corresponding to the service recording video.

According to a third aspect of the embodiments of the present disclosure, there is provided a video processing method, including:

acquiring a service recording video, wherein the service recording video is a video obtained by recording a service execution video generated in the process of executing the target cloud service on a target user account from recording a start video frame corresponding to a start identifier;

acquiring a service recording audio, wherein the service recording audio refers to an audio obtained by acquiring an account from an audio acquisition account at a moment corresponding to the initial video frame in the process that the terminal executes the target cloud service in the target user account;

synthesizing the service recorded video and the service recorded audio to obtain a recorded synthesized video;

and sending recording completion information corresponding to the recorded synthetic video to the terminal.

In one possible design, the synthesizing of the service recorded video and the service recorded audio to obtain a recorded synthesized video includes:

acquiring the single recording mark;

and synthesizing the service recording video and the service recording audio corresponding to the single recording identification to obtain a recording synthesized video.

In one possible design, the method further includes:

receiving a video sharing request sent by the terminal, wherein the video sharing request comprises sharing position information;

sending the recorded composite video to a target sharing position corresponding to the sharing position information;

and sending a video sharing success prompt message to the terminal.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a video processing apparatus including:

the request sending module is configured to execute sending of a video recording request to a first server, wherein the video recording request is used for indicating the first server to record a service execution video generated in the process of executing a target cloud service by a target user account, so that a service recording video is obtained;

the position identifier receiving module is configured to execute receiving of a recording start identifier corresponding to a start video frame of the service recording video sent by the first server;

the audio recording module is configured to perform audio acquisition from a moment corresponding to the initial video frame according to the recording initial identifier in the process of executing the target cloud service by the target user account to obtain a service recording audio;

the audio sending module is configured to execute sending the service recording audio to a second server;

and the information receiving module is configured to execute receiving of recording completion information corresponding to a recorded synthetic video sent by the second server, wherein the recorded synthetic video is a video obtained by synthesizing the service recorded video and the service recorded audio.

In one possible design, the request to record the video includes an identification of a single recording, and the apparatus further includes:

the recording identifier generation module is configured to generate the single recording identifier if a video recording instruction is detected in the process of executing the target cloud service by the target user account;

a request generation module configured to perform generation of the video recording request based on the single recording identification.

In one possible design, the audio recording module is further configured to perform:

In one possible design, the audio transmission module is further configured to perform:

In one possible design, the apparatus further includes:

and the recording instruction generating module is configured to generate the video recording instruction when the execution operation is detected to be a preset recording operation in the process of executing the target cloud service by the target user account.

In one possible design, the apparatus further includes:

and the recording instruction generating module is configured to generate the video recording instruction if the target cloud service is detected to reach the target progress in the process of executing the target cloud service by the target user account.

In one possible design, the request sending module is further configured to perform:

the information receiving module is further configured to execute receiving of the video sharing success prompt information sent by the second server.

According to a fifth aspect of the embodiments of the present disclosure, there is provided a video processing apparatus including:

the request receiving module is configured to execute a video recording request sent by a receiving terminal;

the position identification determining module is configured to execute recording starting identification corresponding to a starting video frame for determining video recording, wherein the recording starting identification is used for indicating a terminal to acquire audio from the moment corresponding to the starting video frame in the process that the target user account executes the target cloud service, so as to obtain service recording audio;

a video recording module configured to record a service execution video generated in the process of executing the target cloud service on the target user account from the start video frame to obtain the service recorded video;

a position identifier sending module configured to execute sending the recording start identifier to the terminal;

the video sending module is configured to execute sending of the service recording video to a second server;

In one possible design, the video recording request includes a single recording identifier, the service recorded video is a recorded video corresponding to the single recording identifier, and the video sending module is further configured to execute:

According to a sixth aspect of the embodiments of the present disclosure, there is provided a video processing apparatus comprising:

the video acquisition module is configured to execute acquisition of a service recorded video, wherein the service recorded video is a video obtained by recording a service execution video generated in the process of executing the target cloud service on the target user account from the recording of the start video frame corresponding to the start identifier;

the audio acquisition module is configured to execute acquisition of a service recording audio, wherein the service recording audio refers to an audio obtained by acquiring an audio from a moment corresponding to the starting video frame in the process that the terminal executes the target cloud service in the target user account;

the video synthesis module is configured to perform synthesis processing on the service recording video and the service recording audio to obtain a recording synthesis video;

and the information sending module is configured to execute sending of the recording completion information corresponding to the recorded composite video to the terminal.

In one possible design, the service recorded video and the service recorded audio correspond to a same single recording identifier, and the video synthesizing module includes:

an identification acquisition unit configured to perform acquisition of the single recording identification;

and the video synthesis unit is configured to perform synthesis processing on the service recording video and the service recording audio corresponding to the single recording identifier to obtain a recording synthesis video.

In one possible design, the apparatus further includes:

the request receiving module is configured to execute receiving of a video sharing request sent by the terminal, and the video sharing request comprises sharing position information;

the video sharing module is configured to send the recorded synthetic video to a target sharing position corresponding to the sharing position information;

the information sending module is further configured to execute sending of video sharing success prompt information to the terminal.

According to a seventh aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including: a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to implement the method according to any one of the first, second, and third aspects described above.

According to an eighth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, wherein instructions of the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method of any one of the first, second, and third aspects of the embodiments of the present disclosure.

According to a ninth aspect of the embodiments of the present disclosure, there is provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the method of any one of the first, second, third aspects of the embodiments of the present disclosure.

The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:

the cloud server records the service execution video generated in the process of executing the target cloud service on the target account to obtain a service recorded video, the stability of the recorded video can be ensured, the cloud server sends a recording start identifier to the terminal, the terminal can record the user audio generated in the process of executing the target cloud service on the target account from the playing of a start video frame corresponding to the recording start identifier to obtain a service recorded audio corresponding to the service recorded video in time sequence, the time delay between the video and the audio can be eliminated, the matching consistency of the video and the audio in time sequence is kept, the occupation of terminal computing resources in the process of executing the target cloud service on the target account is reduced, the terminal sends the recorded service recorded audio to the cloud server, and the cloud server can synthesize the service recorded video local at the cloud end and the service executed audio recorded by the terminal, the recorded synthetic video is obtained, occupation of terminal computing resources in the video recording process is effectively reduced, and the efficiency of video recording in the cloud application scene is integrally improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

FIG. 1 illustrates a schematic diagram of an application environment, according to an example embodiment.

FIG. 2 is a flow chart one of a video processing method according to an exemplary embodiment;

FIG. 3 is a flow chart diagram two illustrating a video processing method in accordance with an exemplary embodiment;

FIG. 4 is a flow diagram three illustrating a video processing method in accordance with an exemplary embodiment;

FIG. 5 illustrates a schematic view of a page for manually recording a cloud game video;

FIG. 6 illustrates a schematic view of a page for automatically recording a cloud game video;

fig. 7 illustrates a flow chart of recording a cloud game video;

FIG. 8 is a block diagram of a video processing apparatus shown in accordance with an exemplary embodiment;

FIG. 9 is a block diagram of a video processing apparatus shown as II in accordance with an exemplary embodiment;

FIG. 10 is a block diagram of a video processing apparatus shown in accordance with an exemplary embodiment;

FIG. 11 is a block diagram illustrating an electronic device for video processing in accordance with an exemplary embodiment.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

It should be noted that, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for presentation, analyzed data, etc.) referred to in the present disclosure are information and data authorized by the user or sufficiently authorized by each party.

Referring to fig. 1, fig. 1 is a schematic diagram illustrating an application environment according to an exemplary embodiment, and as shown in fig. 1, the application environment may include a terminal 100 and a server 200.

The terminal 100 can be used to present a cloud application page to any user to enable the user to perform cloud tasks. Specifically, the terminal 100 may include, but is not limited to, a smart phone, a desktop computer, a tablet computer, a notebook computer, a smart speaker, a digital assistant, an Augmented Reality (AR)/Virtual Reality (VR) device, a smart wearable device, and other types of electronic devices, and may also be software running on the electronic devices, such as an application program. Optionally, the operating system running on the electronic device may include, but is not limited to, an android system, an IOS system, Linux, Windows, and the like.

In an alternative embodiment, the server 200 may provide a cloud service for the terminal 100, and generate a service execution video to be displayed by the terminal 100. Specifically, the server 200 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a Network service, cloud communication, a middleware service, a domain name service, a security service, a CDN (Content Delivery Network), a big data and artificial intelligence platform, and the like.

In addition, it should be noted that fig. 1 shows only one application environment provided by the present disclosure, and in practical applications, other application environments may also be included, for example, more terminals may be included.

In the embodiment of the present specification, the terminal 100 and the server 200 may be directly or indirectly connected through wired or wireless communication, and the disclosure is not limited herein.

FIG. 2 is a flow chart of a video processing method according to an exemplary embodiment, as shown in FIG. 2, the video processing method is used in a terminal electronic device, and includes the following steps (201-209).

Step 201, the terminal sends a video recording request to a first server.

Correspondingly, the first server receives a video recording request sent by the terminal. The video recording request is used for indicating the first server to record a service execution video generated in the process of executing the target cloud service by the target user account, so that a service recording video is obtained.

The terminal can be loaded with a cloud application page corresponding to the cloud application, and a user can perform preset operation based on the cloud application page to execute a cloud task in the cloud application. The target cloud service refers to any cloud service and cloud service executed by a user. The target user account refers to a current user account logged in the terminal.

The logic operation and data processing of the cloud application are mostly executed on the server side, and the service execution video is generated by the server based on operation information generated in the process of executing the target cloud service by the target user account sent by the terminal. For example, the first server receives operation information sent by the terminal, and generates a next frame cloud application page of the service execution video based on the operation information.

In some application scenarios, the cloud application is a cloud game. Cloud gaming is a new technology based on cloud computing. In the cloud game model, all game logic and rendering are run on the server side, and then compressed video is transmitted to the user from the server, so that a mobile phone with particularly good performance is not needed by the player, and the only requirement is basic video decompression software and a reliable network. The cloud game gets rid of the dependence on hardware. For the server, only the performance of the server needs to be improved without developing a new host; it is possible for the user to obtain higher image quality without purchasing a high-performance computer.

In step 202, the first server determines a recording start identifier corresponding to a start video frame of a video recording.

The recording start identifier is used for indicating the terminal to carry out audio acquisition from the moment corresponding to the start video frame in the process of executing the target cloud service by the target user account to obtain a service recording audio.

After receiving the video recording request, the first server records a service execution video generated in the process of executing the target cloud service by the target user account, determines a starting video frame of video recording during recording, and generates a recording starting identifier corresponding to the starting video frame, wherein the recording starting identifier is used for representing the starting position information of video recording, namely identifying which frame of the service execution video the starting frame of the first server starts recording. The recording start identifier may be represented in various forms, and may be a specific number of frames, or may be a special mark (tag) corresponding to a video frame, which is not limited in this disclosure.

The video frame in the cloud application is generated by the server based on the operation information sent by the terminal, and the server sends the video frame to the terminal after the video frame is generated, which means that the moment when the server generates and records the video frame is earlier than the moment when the terminal receives and plays the video frame. The moment of generating the starting video frame in the server is assumed to be a first moment, the starting video frame is sent to the terminal after being generated, the moment of receiving the starting video frame by the terminal is assumed to be a second moment, time delay may exist between the first moment and the second moment, and the influence caused by the time delay can be eliminated by recording the starting video frame of the video recording marked by the starting identification mark. The description is made by an example, a server starts recording a video from a start video frame, and informs a terminal of which the start video frame to start recording is through a recording start identifier, and the terminal restarts audio recording when playing the start video frame, although the start time of video recording on the server side may be earlier than the start time of audio recording on the terminal side, the content of the start audio frame of audio recording is audio content matched with the start video frame, because it collects user audio generated when the user sees the picture content corresponding to the start video frame on the terminal, the recording start identifier is used to identify the position of the start video frame of video recording, and it can be ensured that the content of the service recording audio recorded on the terminal is matched and synchronized with the service recording video recorded on the server side.

Step 203, the first server records a service execution video generated in the process of executing the target cloud service on the target user account from the initial video frame to obtain a service recording video.

The first server receives operation information generated in the process that a target user account executes a target cloud service in the video recording process. And generating a new video frame corresponding to the service execution video based on the operation information, and storing the new video frame to obtain the service recording video.

In an exemplary embodiment, in the process that a target cloud service is executed by a target user account, if a video recording stopping instruction is detected, recording of a user video is stopped, and a service recording audio is obtained.

In a possible implementation manner, in the process that the target user account executes the target cloud service, the first server generates a video recording stop instruction if it is detected that the target cloud service reaches the recording stop progress. And sends a recording stop instruction to the terminal. Optionally, the recording stop instruction includes a recording end identifier, configured to represent an end video frame corresponding to the service recording video, so as to instruct the terminal to stop recording a user audio generated after the end video frame, and record only the user audio generated between the start video frame and the end video frame, so as to obtain the service recording audio.

Step 204, the first server sends a recording start identifier to the terminal.

The first server transmits the determined recording start identifier to the terminal so that the terminal performs step 205 described below.

Correspondingly, the terminal receives a recording start identifier corresponding to a start video frame of the service recording video sent by the first server.

Step 205, in the process that the terminal executes the target cloud service in the target user account, according to the recording start identifier, audio acquisition is performed from the moment corresponding to the start video frame, so as to obtain a service recording audio.

And the terminal receives the service execution video stream sent by the first server. According to the recording start identification, determining a start video frame of a service recording video from a service execution video stream, starting from the moment of playing the start video frame, starting to record the audio from the user audio generated when the user pointed by the target user account watches the picture content corresponding to the start video frame, and continuously recording the user audio in the video recording process.

In an exemplary embodiment, in the process that the terminal executes the target cloud service in the target user account, if a video recording stop instruction is detected, recording of the user audio is stopped, and a service recorded audio is obtained.

In a possible implementation manner, in the process of executing the target cloud service by the target user account, if it is detected that the execution operation is a preset recording stop operation, a video recording stop instruction is generated.

And the terminal detects a video recording stopping instruction and sends a recording stopping request to the first server. Optionally, the recording stop request includes a recording end identifier, and the recording end identifier, similarly to the recording start position identifier, represents a position of an end video frame, so as to ensure that the service recorded video and the service recorded audio are matched and synchronized. And the first server records the service execution video only from the starting video frame to the ending video frame to obtain a service recorded video.

And step 206, the terminal sends the service recording audio to the second server.

Correspondingly, acquiring a service recording audio, wherein the service recording audio refers to an audio obtained by acquiring an account from an audio acquisition account from a moment corresponding to an initial video frame in the process that a target user account executes a target cloud service.

The terminal can send the recorded service recording audio data to the second server in real time, or send an audio file corresponding to the service recording audio to the second server after the recording is completed.

Step 207, the first server sends the service recording video to the second server.

The service recorded video and the service recorded audio are used for synthesizing and recording the synthesized video.

The first server may send the recorded service recording video data to the second server in real time, or send the video file corresponding to the service recording video to the second server after the recording is completed.

Correspondingly, the second server acquires a service recording video, wherein the service recording video refers to a video obtained by recording a service execution video generated in the process of executing the target cloud service by the target user account from the recording of the start video frame corresponding to the start identifier.

And step 208, the second server synthesizes the service recorded video and the service recorded audio to obtain a recorded synthetic video.

The above-described synthesizing process is a process of synthesizing audio and video. Optionally, the service recorded video includes an application audio generated in a process of executing the target application by the target user account.

Step 209, the second server sends recording completion information corresponding to the recorded composite video to the terminal.

Correspondingly, the terminal receives the recording completion information corresponding to the recorded composite video sent by the second server.

The recorded synthetic video is a video obtained by synthesizing the service recorded video and the service recorded audio.

Optionally, the first server and the second server may be the same server or different servers, which is not limited in this disclosure. The second server may also perform a video recording process in the first server.

In summary, according to the technical scheme provided by the embodiment of the present disclosure, a cloud server records a service execution video generated in a process of executing a target cloud service on a target account to obtain a service recorded video, which can ensure the stability of the recorded video, the cloud server sends a recording start identifier to a terminal, the terminal can record a user audio generated in the process of executing the target cloud service on the target account from playing a start video frame corresponding to the recording start identifier to obtain a service recorded audio corresponding to the service recorded video in a time sequence, which can eliminate a time delay between the video and the audio, maintain the matching consistency of the video and the audio in the time sequence, reduce the occupation of computing resources of the terminal in the process of executing the target cloud service on the target account, the terminal sends the recorded service recorded audio to the cloud server, and the cloud server can synthesize the service recorded video recorded locally at the cloud end and the service execution audio recorded at the terminal, the recorded synthetic video is obtained, occupation of terminal computing resources in the video recording process is effectively reduced, and the efficiency of video recording in the cloud application scene is integrally improved.

In an exemplary embodiment, to ensure that the service recorded video and the service recorded audio synthesized by the second server are videos and audios matched with each other in the same recording process, the terminal may generate a unique single recording identifier for each recording, so as to determine the service recorded audio and the service recorded video matched with each other. In this embodiment, the video recording request includes a single recording identifier. Accordingly, as shown in fig. 3, fig. 3 is a flow chart two illustrating a video processing method according to an exemplary embodiment. In FIG. 3, before the step 201, the following steps (210-211) are further included.

In step 210, in the process that the terminal executes the target cloud service in the target user account, if a video recording instruction is detected, a single recording identifier is generated.

Optionally, the form of the single-recording identifier includes, but is not limited to, a character string, a numerical sequence, and an ID (Identity Document).

In a possible implementation manner, in the process of executing the target cloud service by the target user account, if it is detected that the execution operation is a preset recording operation, a video recording instruction is generated.

The executing operation refers to an operation generated by a user pointed by a target user account in the process of executing the target cloud service, and the preset recording operation refers to an operation of triggering video recording. The video recording instruction refers to an instruction for triggering a video recording process. Taking a cloud game scene as an example, the above embodiment may be used for manually recording a cloud game video.

By detecting whether the execution operation is preset or not, whether video recording is carried out or not is further determined, and the flexibility of video recording in a cloud application scene can be improved.

In another possible implementation manner, in the process of executing the target cloud service by the target user account, if it is detected that the target cloud service reaches the target progress, a video recording instruction is generated.

The target progress refers to a preset task progress, and when the progress of the user, pointed by the target user account, in executing the target cloud service reaches the target progress, a video recording instruction is generated. Taking a cloud game scene as an example, the above embodiment may be used to automatically record a cloud game video, and the target progress may be game play starting.

Whether the target cloud service reaches the target progress or not is detected, and whether video recording is conducted or not is further determined, so that convenience of video recording in a cloud application scene can be improved.

And step 211, the terminal generates a video recording request based on the single recording identifier.

The uniqueness of each recording is represented by the single recording identification, so that the accuracy of video synthesis can be ensured.

After the terminal executes step 211, step 201 may be executed to send a single recording identifier representing the current recording to the first server in the request.

After the first server receives the video recording request sent by the terminal, the service recorded video obtained by executing step 203 is a recorded video corresponding to the single recording identifier.

Correspondingly, the service recorded audio recorded by the terminal is also the recorded audio corresponding to the single recording identifier. Therefore, as shown in fig. 3, the step 205 can be alternatively implemented by the following step 205 a.

In step 205a, in the process that the terminal executes the target cloud service in the target user account, according to the single recording identifier and the recording start identifier, audio acquisition is performed from the moment corresponding to the start video frame, so as to obtain a service recording audio corresponding to the single recording identifier.

By binding the service recorded audio with the single recorded identifier, each recording process can be distinguished conveniently to record the audio for the self-corresponding service, video synthesis errors are avoided, and the accuracy of video synthesis is ensured.

After the terminal generates the service recording audio corresponding to the single recording identifier, the single recording identifier and the service recording audio are required to be sent to the second server together. Therefore, as shown in fig. 3, the step 206 can be alternatively implemented by the step 206a described below.

In step 206a, the terminal sends the service recording audio and the single recording identifier to the second server.

The single recording identifier is used for indicating the second server to determine the service recording video corresponding to the service recording audio.

The service recording audio and the single recording identifier are sent to the second server together, so that the second server can determine the service recording audio corresponding to the recording according to the single recording identifier, video synthesis errors are avoided, and the accuracy of video synthesis is guaranteed.

Similarly, after the first server generates the service recording video corresponding to the single recording identifier, the single recording identifier and the service recording video are also sent to the second server together. Therefore, as shown in fig. 3, the step 207 can be alternatively implemented by the step 207a described below.

Step 207a, the first server sends the service recording video and the single recording identifier to the second server.

The single recording identifier is used for indicating the second server to determine the service recording audio corresponding to the service recording video.

The service recording video and the single recording identifier are sent to the second server together, so that the second server can determine the service recording video corresponding to the recording according to the single recording identifier, video synthesis errors are avoided, and the accuracy of video synthesis is guaranteed.

Correspondingly, the second server obtains the single recording identification. The specific process is that the second server receives a service recording audio and a single recording identifier sent by the terminal; and the second server receives the service recording video and the single recording identification sent by the first server.

The second server can provide video recording and synthesizing service for a plurality of terminals simultaneously, so that the second client can receive a plurality of service recording videos and single recording identifications corresponding to the service recording videos, and a plurality of service recording audios and single recording identifications corresponding to the service recording audios. Therefore, for the service recorded video and the service recorded audio subjected to the synthesis processing to be mutually matched video and audio in the same recording process, the second server needs to perform the synthesis processing according to the single recording identifier. Therefore, as shown in fig. 3, the step 208 can be alternatively implemented by the following step 208 a.

And 208a, synthesizing the service recording video and the service recording audio corresponding to the single recording identifier to obtain a recorded synthesized video.

To sum up, according to the technical scheme provided by the embodiment of the disclosure, the terminal represents the uniqueness of each recording by generating the single recording identifier, and adds the single recording identifier to the recording request video to the cloud server, so that the cloud server records the service recording video corresponding to the single recording identifier, the terminal side records the service recording audio corresponding to the single recording identifier, and sends the service recording audio and the single recording identifier to the cloud server together, and the cloud server can determine the service recording video and the service recording audio corresponding to the current recording task according to the single recording identifier, and synthesize the video and the service recording audio to obtain the recorded synthesized video, thereby avoiding synthesizing the video and the audio which do not correspond, and effectively ensuring the accuracy of video recording in the cloud application scene.

In an exemplary embodiment, the terminal may perform a related operation, such as sharing a recorded composite video or downloading a recorded composite video, according to the received recording completion information. Thus, as shown in fig. 4, fig. 4 is a flowchart three illustrating a video processing method according to an exemplary embodiment. In FIG. 4, after the step 209, the following steps (212-216) can be further included.

In step 212, the terminal sends a video sharing request to the second server in response to the recorded video sharing instruction.

The video sharing request comprises sharing position information, and the sharing position information is used for indicating the second server to send the recorded and synthesized video to a target sharing position corresponding to the sharing position information.

Correspondingly, the second server receives a video sharing request sent by the terminal, wherein the video sharing request comprises sharing position information.

In step 213, the second server sends the recorded composite video to a target sharing location corresponding to the sharing location information.

And step 214, the second server sends a video sharing success prompt message to the terminal.

Correspondingly, the terminal receives the video sharing success prompt message sent by the second server.

In step 215, the terminal sends a video download request to the second server in response to the recorded video download instruction.

Correspondingly, the second server receives the video downloading request sent by the terminal.

And step 216, the second server sends the recorded composite video to the terminal.

Correspondingly, the terminal receives the recorded composite video sent by the second server.

In one example, as shown in fig. 5, a schematic view of a page for manually recording a cloud game video is exemplarily shown. For the manual recording mode, a user can start and stop the process of recording the cloud game video at any time, also can record the voice commentary in the recording process, and finally generates complete video content at the cloud end after the recording is finished. In fig. 5, in order to guide the user to record the video during the cloud game, a recording prompt information box 512 may be displayed in the cloud game page 51, and a recording start control 511 may be displayed in the recording prompt information box 512. After the user performs corresponding operations, such as clicking, on the recording start control 511, the cloud game video recording process is performed. In the process of recording the cloud game video at the cloud end, the terminal can display a cloud game recording page 52, and a recording pause control 521, a recording end control 522 and a voice recording control 523 are displayed in the cloud game recording page 52. The user may click the recording pause control 521 to pause the recording process of the cloud game video, the recording process of the cloud game video is not finished, the recording pause control 521 may be alternatively displayed as the recording start control 511 (not shown in the cloud game recording page 52), and the user may continue recording by the recording start control 511. After the user clicks the voice recording control 523, the recording function is started, and the terminal uploads the recorded audio to the cloud and synthesizes the audio with the video recorded by the cloud. Clicking the voice recording control 523 again closes the recording function. The user clicks the recording end control 522 to enter a video recording completion process. After the cloud video is synthesized, the terminal can display a cloud game video recording completion prompt page 53, and the cloud game video recording completion prompt page 53 includes a video downloading control 531, a video sharing control 532 and a video previewing control 533. After the user clicks the video downloading control 531, the terminal downloads the video synthesized by the cloud to the local. If a user wants to publish the video synthesized by the cloud to a specified video platform, the user can click the video sharing control 532, the cloud is directly connected to a video publishing interface of the specified video platform in an abutting mode, the synthesized video is directly transmitted to the video platform, and therefore the terminal consumption flow and the terminal local storage space are saved. Optionally, the cloud may directly transmit the composite video with the highest definition to the video platform. The user can also click the video preview control 533 to watch the video synthesized by the cloud.

In one example, as shown in fig. 6, a schematic diagram of a page for automatically recording a cloud game video is exemplarily shown. The automatic recording mode is that after the user enters the cloud game, the user is automatically identified to enter the game, the recording is automatically started, and after the game is finished, the recording is automatically finished, and the user is reminded to download/share the video. Games for which the automatic mode applies: the game system is suitable for MOBA (Multiplayer Online Battle Arena), shooting, chess and cards and the like, and has two scenes of game halls and game match. Optionally, the automatic recording mode automatically records cloud game video for the user only during game play. In fig. 6, the terminal may display an automatic recording mode setting page 61, where the automatic recording mode setting page 61 includes a cloud automatic recording switch control 611, and the user may perform corresponding operation on the cloud automatic recording switch control 611 to turn on or turn off the automatic recording mode. Under the condition that the automatic recording mode is started, a user enters game match, and then the recording of the cloud game process is started. The terminal may display the cloud game recording page 52 during the recording process, and operations that are performed on the cloud game recording page 52 and on the cloud game recording page 52 have been described in the above example, and are not described herein again. And after the game is matched, stopping recording the cloud game video, and waiting for the cloud video to be synthesized by the terminal. After the cloud video synthesis is completed, the terminal can display a prompt page 63 for completion of recording the opposite videos. The opposite video recording completion prompt page 63 includes an opposite video sharing button 631, an opposite video downloading button 632, and an opposite video preview control 633. After the user clicks the game video download button 632, the terminal downloads the game video synthesized by the cloud to the local. If a user wants to release the office video synthesized by the cloud to a specified video platform, the office video sharing button 631 can be clicked, the cloud is directly connected to a video release interface of the specified video platform in an abutting mode, the synthesized office video is directly transmitted to the video platform, and therefore the terminal consumption flow and the terminal local storage space are saved. Optionally, the cloud may directly transmit the peer video with the highest definition to the video platform. The user can also click the game video preview control 633 to watch the game video synthesized by the cloud.

In one example, as shown in fig. 7, a flow chart of recording a cloud game video is illustrated. Fig. 7 shows a video recording process, a video sharing process, and a video downloading process.

For the video recording process:

the real machine terminal initiates a recording request to the cloud host and synchronously informs the cloud host terminal.

The cloud host computer end starts to record game audio and video of the cloud game, a tag is printed at the recording starting position, the tag is sent to the real computer end, and the real computer end starts a microphone according to the tag and records the main broadcasting explanation audio.

And after the real machine end clicks and records, the real machine end locally finishes recording the main broadcasting explanation audio and synchronously informs the cloud host end to finish recording the game audio and video of the cloud game.

And after the recording is finished, the cloud host and the real machine end respectively upload the recorded game audio and video and the explanation audio.

And after receiving the game audio and video and the explanation audio, the server matches the game audio and video and the explanation audio recorded at the same time according to the unique ID to synthesize the complete audio and video.

And the server stores the synthesized complete audio and video to the local.

For the video sharing process:

after the video recording is completed, the real machine terminal initiates a sharing request aiming at completing the audio and video to the server terminal.

And after receiving the sharing request, the server side is connected to a video publishing interface of the target server side and uploads the synthesized audio and video with the highest definition to the target server side.

For the video download process:

the real machine terminal can also store the synthetic audio/video to the local, and the real machine terminal initiates a request for storing to the local to the server terminal.

And after receiving the request, the server returns the synthesized audio and video to the real machine terminal.

In summary, according to the technical scheme provided by the embodiment of the present disclosure, corresponding operations, such as sharing or downloading, may be performed on the recorded composite video according to corresponding operations of the user, so as to enrich an application scenario of video recording and reduce terminal computation pressure.

Fig. 8 is a block diagram of a video processing apparatus shown in accordance with an example embodiment. Referring to fig. 8, the apparatus 800 includes:

the request sending module 810 is configured to execute sending of a video recording request to a first server, where the video recording request is used to instruct the first server to record a service execution video generated in a process of executing a target cloud service by a target user account, so as to obtain a service recording video;

a location identifier receiving module 820 configured to perform receiving a recording start identifier corresponding to a start video frame of the service recording video sent by the first server;

the audio recording module 830 is configured to perform audio acquisition from a moment corresponding to the start video frame according to the recording start identifier in the process of executing the target cloud service by the target user account, so as to obtain a service recording audio;

an audio sending module 840 configured to perform sending the service recording audio to a second server;

an information receiving module 850 configured to perform receiving of recording completion information corresponding to a recorded composite video sent by the second server, where the recorded composite video is a video obtained by synthesizing the service recorded video and the service recorded audio.

In one possible design, the audio recording module 830 is further configured to perform:

In one possible design, the audio transmission module 840 is further configured to perform:

In one possible design, the apparatus further includes:

In one possible design, the request sending module 810 is further configured to perform:

the information receiving module 850 is further configured to perform receiving of the video sharing success prompt information sent by the second server.

Fig. 9 is a block diagram of a video processing apparatus shown in accordance with an exemplary embodiment. Referring to fig. 9, the apparatus 900 includes:

a request receiving module 910 configured to execute a video recording request sent by a receiving terminal;

a position identifier determining module 920, configured to execute a recording start identifier corresponding to a start video frame for determining video recording, where the recording start identifier is used to instruct a terminal to perform audio acquisition from a time corresponding to the start video frame in a process that the target user account executes the target cloud service, so as to obtain a service recording audio;

a video recording module 930 configured to record, from the start video frame, a service execution video generated in the process of executing the target cloud service on the target user account, so as to obtain the service recorded video;

a location identifier sending module 940 configured to execute sending the recording start identifier to the terminal;

a video sending module 950 configured to perform sending the service recording video to a second server;

In one possible design, the request for recording a video includes a single recording identifier, the service recorded video is a recorded video corresponding to the single recording identifier, and the video sending module 950 is further configured to perform:

Fig. 10 is a block diagram of a video processing apparatus shown in accordance with an exemplary embodiment. Referring to fig. 10, the apparatus 1000 includes:

the video acquiring module 1010 is configured to execute acquiring a service recorded video, where the service recorded video is a video obtained by recording a service execution video generated in a process of executing a target cloud service on a target user account from a start video frame corresponding to a recording start identifier;

an audio obtaining module 1020 configured to perform obtaining of a service recording audio, where the service recording audio is an audio obtained by a terminal performing audio acquisition from a time corresponding to the start video frame in a process that the target user account executes the target cloud service;

a video synthesis module 1030 configured to perform synthesis processing on the service recorded video and the service recorded audio to obtain a recorded synthesized video;

an information sending module 1040, configured to execute sending, to the terminal, recording completion information corresponding to the recorded composite video.

In a possible design, the service recording video and the service recording audio correspond to the same single recording identifier, and the video synthesizing module 1040 includes:

In one possible design, the apparatus further includes:

the information sending module 1040 is further configured to execute sending of a video sharing success prompt message to the terminal.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Fig. 11 is a block diagram illustrating an electronic device for video processing, which may be a terminal, according to an exemplary embodiment, and an internal structure thereof may be as shown in fig. 11. The electronic device comprises a processor, a memory, a network interface, a display screen and an input device which are connected through a system bus. Wherein the processor of the electronic device is configured to provide computing and control capabilities. The memory of the electronic equipment comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the electronic device is used for connecting and communicating with an external terminal through a network. The computer program is executed by a processor to implement a video processing method. The display screen of the electronic equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the electronic equipment, an external keyboard, a touch pad or a mouse and the like.

Those skilled in the art will appreciate that the architecture shown in fig. 11 is merely a block diagram of some of the structures associated with the disclosed aspects and does not constitute a limitation on the electronic devices to which the disclosed aspects apply, as a particular electronic device may include more or less components than those shown, or combine certain components, or have a different arrangement of components.

In an exemplary embodiment, there is also provided an electronic device including: a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to implement the video processing method as in the embodiments of the present disclosure.

In an exemplary embodiment, there is also provided a computer-readable storage medium, in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform a video processing method in an embodiment of the present disclosure.

In an exemplary embodiment, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the video processing method in the embodiments of the present disclosure.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in embodiments provided by the present disclosure may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A video processing method, comprising:

sending the service recording audio to a second server;

2. The video processing method of claim 1, wherein the request to record video includes an identification of a single recording, and before sending the request to record video to the first server, further comprising:

3. A video processing method, comprising:

receiving a video recording request sent by a terminal;

sending the recording starting identifier to the terminal;

sending the service recorded video to a second server;

4. A video processing method, comprising:

5. A video processing apparatus, comprising:

6. A video processing apparatus, comprising:

a video recording module configured to record a service execution video generated in the process of executing the target cloud service on the target user account from the start video frame to obtain a service recording video;

7. A video processing apparatus, comprising:

the audio acquisition module is configured to execute acquisition of a service recording audio, wherein the service recording audio refers to an audio obtained by a terminal performing audio acquisition account from a moment corresponding to the starting video frame in the process of executing the target cloud service by the target user account;

8. An electronic device, comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the video processing method of claim 1 or 2, or to implement the video processing method of claim 3, or to implement the video processing method of claim 4.

9. A computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the video processing method of claim 1 or 2, or to implement the video processing method of claim 3, or to implement the video processing method of claim 4.

10. A computer program product comprising computer instructions, characterized in that the computer instructions, when executed by a processor, implement the video processing method according to claim 1 or 2, or implement the video processing method according to claim 3, or implement the video processing method according to claim 4.