WO2022017096A1

WO2022017096A1 - Screen recording method, electronic device, and computer readable storage medium

Info

Publication number: WO2022017096A1
Application number: PCT/CN2021/101144
Authority: WO
Inventors: 郑佳佳
Original assignee: 上海连尚网络科技有限公司
Priority date: 2020-07-20
Filing date: 2021-06-21
Publication date: 2022-01-27
Also published as: CN111866577A; CN111866577B

Abstract

The present application provides a screen recording method, an electronic device, and a computer readable storage medium. An application switching event of a terminal is monitored in a screen recording process of the terminal, and then, according to the monitored application switching event and an application of the terminal to be subjected to screen recording, marking information of a recorded video is set for indicating a portion of the recorded video related to said application, so that a screen recording file of said application can be generated according to the recorded video and the marking information of the recorded video. The marking information indicating the portion of the recorded video related to said application is set in the screen recording process of the terminal, so that the portion related to said application is identified from the recorded video according to the marking information to synthesize the screen recording file of said application, and a portion unrelated to said application is filtered out, and thus the reliability of screen recording is effectively improved.

Description

Screen recording method, electronic device, and computer-readable storage medium

【Technical field】

The present application relates to image processing technologies, and in particular, to a screen recording method, an electronic device, and a computer-readable storage medium.

【Background technique】

Screen recording is usually used to record and store the content displayed by the terminal over a period of time, such as user operations and application running. The existing screen recording method is to capture frame images on the screen through an application program interface (Application Program Interface, API) provided by the operating system within a period of time, and store the captured frame images on the terminal in the form of video.

However, the existing screen recording method completes the recording by continuously capturing images on the screen, which may generate a large amount of irrelevant image information. For example, during the screen recording process, the user needs to operate the terminal to run other Irrelevant applications, etc., make the final recorded video contain irrelevant content, thereby reducing the reliability of screen recording.

[Content of the invention]

Various aspects of the present application provide a screen recording method, an electronic device, and a computer-readable storage medium, so as to improve the reliability of screen recording.

One aspect of the present application provides a screen recording method, including:

During the screen recording process of the terminal, monitor the application switching event of the terminal;

According to the monitored application switching event and the application to be screen-recorded of the terminal, set the tag information of the recorded video to indicate the part of the recorded video that is related to the application to be screen-recorded;

A screen recording file of the application to be screen recorded is generated according to the recorded video and the tag information of the recorded video.

Another aspect of the present application provides an electronic device, the device comprising:

one or more processors;

storage means for storing one or more programs,

When the one or more programs are executed by the one or more processors, the one or more processors implement a screen recording method provided by the above aspect.

Another aspect of the present application provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the screen recording method provided in the above-mentioned aspect.

It can be known from the above technical solutions that in the embodiment of the present application, the application switching event of the terminal is monitored during the screen recording process of the terminal, and further, according to the monitored application switching event and the application to be recorded on the screen of the terminal, Setting the tag information of the recorded video to indicate the part of the recorded video that is related to the application to be screen-recorded, so that the to-be-screen recording application can be generated according to the recorded video and the tag information of the recorded video The screen recording file of the application, because the marking information indicating the part of the recorded video related to the application to be screen recorded is set during the screen recording process of the terminal, so that the recorded video is identified according to the marking information. The screen recording file of the application to be screen recorded is synthesized by using the part related to the application to be screen recorded, and the part irrelevant to the application to be screen recorded is filtered out, thereby effectively improving the reliability of screen recording.

In addition, by adopting the technical solution provided by the present application, it is possible to automatically synthesize the application to be screened by identifying the part related to the application to be screen-recorded from the recorded video without the need for the user to manually edit the recorded video. The screen recording file can effectively improve the efficiency of screen recording.

In addition, using the technical solutions provided in the present application can effectively improve user experience.

【Description of drawings】

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings that are required in the description of the embodiments or the prior art. Obviously, the drawings in the following description are from the present application. In some embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without any creative effort.

1 is a schematic flowchart of a screen recording method provided by an embodiment of the present application;

Fig. 2 is the concrete realization schematic diagram of the embodiment corresponding to Fig. 1;

Figure 3 is a block diagram of an exemplary computer system/server 12 suitable for use in implementing embodiments of the present application.

【detailed description】

In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

It should be noted that the terminals involved in the embodiments of the present invention may include but are not limited to mobile phones, personal digital assistants (Personal Digital Assistants, PDAs), wireless handheld devices, tablet computers (Tablet Computers), and personal computers (Personal Computers, PCs). ), MP3 players, MP4 players, wearable devices (eg, smart glasses, smart watches, smart bracelets, etc.), etc.

In addition, the term "and/or" in this embodiment of the present application is only an association relationship to describe associated objects, indicating that there may be three relationships, for example, A and/or B, which may indicate that A exists alone, and A exists at the same time and B, there are three cases of B alone. In addition, the character "/" in the embodiments of the present application generally indicates that the related objects before and after are an "or" relationship.

FIG. 1 is a schematic flowchart of a screen recording method provided by an embodiment of the present application, as shown in FIG. 1 .

101. During the screen recording process of the terminal, monitor the application switching event of the terminal.

102. According to the monitored application switching event and the application to be screen-recorded by the terminal, set flag information of the recorded video to indicate the part of the recorded video that is related to the application to be screen-recorded.

103. Generate a screen recording file of the application to be screen recorded according to the recorded video and the tag information of the recorded video.

It should be noted that some or all of the execution bodies of 101 to 103 may be applications located in the terminal, or may also be functional units such as plug-ins or software development kits (Software Development Kit, SDK) set in the applications located in the terminal , or may also be a processing engine located in a network-side server, which is not particularly limited in this embodiment.

It can be understood that the application may be a local program (nativeApp) installed on the terminal, or may also be a web page program (webApp) of a browser on the terminal, which is not limited in this embodiment.

In this way, during the screen recording process of the terminal, the application switching event of the terminal is monitored, and then, according to the monitored application switching event and the application to be screen-recorded by the terminal, the tag information of the recorded video is set , to indicate the part of the recorded video that is related to the application to be screen-recorded, so that the screen recording file of the application to be screen-recorded can be generated according to the recorded video and the tag information of the recorded video. In the screen recording process of the terminal, mark information indicating the part of the recorded video related to the application to be screen recorded is set, so that the part related to the application to be screen recorded is identified from the recorded video according to the mark information. to synthesize the screen recording file of the application to be screen recorded, and filter out the part irrelevant to the application to be screen recorded, thereby effectively improving the reliability of screen recording.

In this application, before the screen recording function is turned on, the application to be screen-recorded of the terminal to be screen-recorded may be determined, or after the screen-recording function is turned on, the application to be screen-recorded of the terminal to be screen-recorded may be determined. The application is not particularly limited.

Optionally, in a possible implementation of this embodiment, the application to be screen-recorded may be specifically determined in response to a user's operation based on a list of supported screen-recording applications before the screen recording process of the terminal.

In this implementation manner, a list of applications supporting screen recording may be provided to the user, which may be referred to as a screen recording application list. The list may include all applications installed on the terminal, or may also include some applications installed on the terminal, which is not particularly limited in this embodiment.

According to the screen recording requirement, the user can select one corresponding application, two applications or multiple applications from the screen recording application list of the terminal as the application to be screen recorded on the terminal.

So far, the application to be screen recorded on the terminal can be determined.

After the application to be screen recorded on the terminal is determined, the screen recording function can be enabled in response to the user's operation based on the screen recording interface, so as to start the screen recording of the terminal.

Optionally, in a possible implementation manner of this embodiment, the application to be screen recorded may be specifically determined in response to a user's operation based on the application to be screen recorded during the screen recording process of the terminal.

In this implementation manner, the screen recording function can be enabled in response to the user's operation based on the screen recording interface to start screen recording of the terminal. During the screen recording process of the terminal, the user can select an application from all the applications installed on the terminal according to the screen recording requirement and start operating the application as the application to be screen recorded on the terminal.

In this application, since the user's screen recording requirement is usually to perform screen recording on one or two or more designated applications to be screen recorded, then, if the terminal is not running the application to be recorded during the screen recording process, but It is to switch to running other applications. At this time, the recorded video is not what the user does not want to record at all. Therefore, the application switching event of the terminal can be monitored, and by monitoring that the application to be screen-recorded is switched to another application, or that another application is switched to the application to be screen-recorded, it is possible to find out in time whether the application to be screen-recorded is performing screen recording.

In the present application, during the screen recording process, if no application switching event is detected, the screen recording method in the prior art can be used to capture frame images on the terminal screen through the API provided by the operating system according to a specified frequency, and the The captured frame images are stored on the terminal in the form of video, and 102 will be executed only when the application switching event is monitored. The application switching event of the terminal and the application to be recorded on the screen of the terminal are set, the mark information of the recorded video is set, and the storage processing is performed.

Optionally, in a possible implementation manner of this embodiment, in step 101 , specifically by monitoring a designated monitoring object, it is possible to determine the monitored application switching event of the terminal.

In a specific implementation process, the running state of the application to be screen-recorded may be specifically monitored, and further, the monitored application switching event of the terminal may be determined according to the monitored running state.

Since the content of the screen recording is the content displayed on the screen of the collection terminal, only when the running state of the application to be screened on the terminal is running in the foreground can the relevant operations of the application to be recorded can be collected, and when the application to be recorded on the terminal is running in the foreground When the running status of the recording application is running in the background, the relevant operations of the application to be screen recorded cannot be collected. Therefore, by monitoring the running state of the application to be screen-recorded, once it is detected that the running state of the application to be screen-recorded changes, that is, from the foreground to the background, and from the background to the foreground, the monitoring can be determined. an application switching event to the terminal.

In another specific implementation process, the screen recording interface of the terminal may be specifically monitored, and further, an application switching event of the terminal that is monitored may be determined according to the monitored application switching in the screen recording interface.

Since the content of the screen recording is the content displayed in the screen recording interface of the collection terminal, only the application interface of the application to be screen recorded on the terminal appears in the screen recording interface of the terminal, it is possible to collect the relevant operations of the application to be recorded. However, when the application interface of the application to be screen-recorded on the terminal does not appear in the screen-recording interface of the terminal, or when other applications appear in the screen-recording interface of the terminal, the relevant operations of the application to be screen-recorded cannot be collected. Therefore, by monitoring the screen recording interface of the terminal, once it is detected that the application in the screen recording interface changes, that is, the application to be screened is changed to another application, and the other application is changed to the application to be screened. The application switching event monitored by the terminal can be determined.

The so-called application switching event may refer to a terminal operation event of switching from one application to another application, and the event may include, but is not limited to, the application identifier of one application before switching and the application identifier of another application after switching.

Optionally, in a possible implementation manner of this embodiment, in 102, as long as an application switching event is monitored, the recorded application switching event may be set according to the monitored application switching event and the application to be screen-recorded by the terminal. Tag information for the video.

At this time, since the tag information of the recorded video is set, the part of the recorded video that is related to the application to be screen-recorded can be indicated, and only this part of the content corresponds to the user's current screen-recording requirement. What needs to be screen recorded.

During the screen recording process, the user can switch applications on the terminal at will without any restrictions. With the above technical solution, any application switching performed by the user can be monitored and marked.

After the application switching event is monitored, it can be further determined, according to the monitored application switching event and the application to be screen-recorded of the terminal, whether the application switching event is an application switching event of switching from the application to be screen-recorded to another application, or whether the application switching event is switched by the application to be screen-recorded to another application. Other applications switch to the application switching event of the application to be screen recorded, so that the flag information of the recorded video can be set.

In a specific implementation process, according to the monitored application switching event and the application to be screen-recorded on the terminal, tag information of the part of the recorded video related to the application to be screen-recorded can be set.

For example, according to the monitored application switching event and the application to be screen recorded on the terminal, the start marker and/or the end marker of the part of the recorded video related to the application to be screen recorded may be set.

If the monitored application switching event is switching from the application to be screen-recorded to another application, you can set the end marker of the part of the recorded video related to the application to be screen-recorded at the current position in the recorded video, and use The part before the end mark in the recorded video is indicated as the part related to the application to be screen-recorded.

So far, according to the end mark, it can be determined that the part before the end mark in the recorded video is the part related to the application to be screen-recorded. If other flags are further set before the end flag, it is necessary to further combine other flags to determine the specific range of the part related to the application to be screen recorded in the recorded video. For example, before the end mark, the start mark of the part related to the application to be screen recorded in the recorded video is further set, then, according to the start mark and the end mark, it can be determined that in the recorded video The part between the start tag and the end tag is the part related to the application to be screen-recorded.

If the monitored application switching event is switching from another application to the application to be screen-recorded, you can set the start marker of the part of the recorded video related to the application to be screen-recorded at the current position in the recorded video, and use The part after the start mark in the recorded video is indicated as the part related to the application to be screen-recorded.

So far, according to the start mark, it can be determined that the part after the start mark in the recorded video is the part related to the application to be screen-recorded. If other flags are further set after the start flag, it is necessary to further combine other flags to determine the specific range of the part related to the application to be screen recorded in the recorded video. For example, after the start mark, the end mark of the part of the recorded video related to the application to be screen-recorded is further set, then, according to the start mark and the end mark, it can be determined that the recorded video is The part between the start tag and the end tag is the part related to the application to be screen-recorded.

Alternatively, for another example, the start time and/or the end time of the portion of the recorded video related to the application to be screen recorded may be specifically recorded according to the monitored application switching event and the application to be screen recorded on the terminal.

If the monitored application switching event is switching from the application to be screen recorded to another application, the recording time from the current moment to the start of recording can be recorded as the end of the part of the recorded video related to the application to be recorded. The time is used to indicate the part of the recorded video before the end time, which is the part related to the application to be recorded on the screen.

So far, according to the end time, it can be determined that the part of the recorded video before the end time is the part related to the application to be screen-recorded. If other times are further recorded before the end time, it is necessary to further combine the other times to determine the specific range of the part related to the application to be screen recorded in the recorded video. For example, before the end time, the start time of the part of the recorded video related to the application to be screen-recorded is further recorded, then, according to the start time and the end time The part between the start time and the end time is the part related to the application to be screen-recorded.

If the monitored application switching event is switching from another application to the application to be screen-recorded, the recording time from the current moment to the start of recording can be recorded as the start of the part of the recorded video related to the application to be screen-recorded The time is used to indicate the part after the start time in the recorded video, which is the part related to the application to be screen-recorded.

So far, according to the start time, it can be determined that the part of the recorded video after the start time is the part related to the application to be recorded on the screen. If other times are further recorded after the start time, it is necessary to further combine the other times to determine the specific range of the part related to the application to be screen recorded in the recorded video. For example, after the start time, the end time of the part of the recorded video related to the application to be screen-recorded is further recorded, then, according to the start time and the end time The part between the start time and the end time is the part related to the application to be screen-recorded.

Alternatively, for another example, the start frame number and/or the end frame number of the portion of the recorded video that is related to the application to be recorded on the screen may be recorded according to the monitored application switching event and the application to be recorded on the screen of the terminal. .

If the monitored application switching event is switching from the application to be screen-recorded to another application, the current frame number can be recorded as the end frame number of the part of the recorded video related to the application to be screen-recorded to indicate when The part before the end frame number in the recorded video is the part related to the application to be screen-recorded.

So far, according to the end frame number, it can be determined that the part before the end frame number in the recorded video is the part related to the application to be recorded on the screen. If other frame numbers are further recorded before the end frame number, it is necessary to further combine the other frame numbers to determine the specific range of the part of the recorded video that is related to the application to be screen-recorded. For example, before the end frame number, the start frame number of the part of the recorded video related to the application to be recorded on the screen is further recorded. Then, it can be determined according to the start frame number and the end frame number. The part between the start frame number and the end frame number in the recorded video is the part related to the application to be screen-recorded.

If the monitored application switching event is switching from another application to the application to be screen-recorded, the current frame number can be recorded as the start frame number of the part of the recorded video that is related to the application to be screen-recorded to indicate when The part after the start frame number in the recorded video is the part related to the application to be screen-recorded.

So far, according to the start frame number, it can be determined that the part after the start frame number in the recorded video is the part related to the application to be recorded on the screen. If other frame numbers are further recorded after the start frame number, then it is necessary to further combine other frame numbers to determine the specific range of the part of the recorded video related to the application to be screen recorded. For example, after the start frame number, the end frame number of the part of the recorded video related to the application to be recorded on the screen is further recorded. Then, it can be determined according to the start frame number and the end frame number The part between the start frame number and the end frame number in the recorded video is the part related to the application to be screen-recorded.

In another specific implementation process, specifically, according to the monitored application switching event and the application to be screen recorded on the terminal, the marking information of the part of the recorded video that is not related to the application to be screen recorded can be set.

For example, according to the monitored application switching event and the application to be screen recorded on the terminal, the start marker and/or the end marker of the part of the recorded video that is not related to the application to be screen recorded can be set.

If the monitored application switching event is switching from the application to be screen-recorded to another application, the current position in the recorded video can be set as the start marker of the part of the recorded video that is not related to the application to be screen-recorded, It is used to indicate that the part before the start mark in the recorded video is the part related to the application to be recorded on the screen.

So far, according to the start mark, it can be determined that the part before the start mark in the recorded video is the part related to the application to be screen-recorded. If other flags are further set before the start flag, it is necessary to further combine other flags to determine the specific range of the part related to the application to be screen recorded in the recorded video. For example, before the start mark, the end mark of the part of the recorded video that is not related to the application to be screen-recorded is further set, then, according to the end mark and the start mark, it can be determined that the recorded video The part between the start tag and the end tag in the video is the part related to the application to be screen-recorded.

If the monitored application switching event is switching from another application to the application to be screen-recorded, then the current position in the recorded video can be set as the end marker of the part of the recorded video that is not related to the application to be screen-recorded, It is used to indicate that the part after the end mark in the recorded video is the part related to the application to be screen-recorded.

So far, according to the end mark, it can be determined that the part after the end mark in the recorded video is the part related to the application to be screen-recorded. If other flags are further set after the end flag, it is necessary to further combine other flags to determine the specific range of the part related to the application to be screen recorded in the recorded video. For example, after the end mark, the start mark of the part of the recorded video that is not related to the application to be screen-recorded is further set, then, according to the end mark and the start mark, it can be determined that the recorded video The part between the start tag and the end tag in the video is the part related to the application to be screen-recorded.

Alternatively, for another example, the start time and/or the end time of a portion of the recorded video that is not related to the application to be screen recorded may be specifically recorded according to the monitored application switching event and the application to be screen recorded on the terminal.

If the monitored application switching event is switching from the application to be screen recorded to another application, the recording time from the current moment to the start of recording can be recorded as the part of the recorded video that is not related to the application to be screen recorded. The start time is used to indicate that the part in the recorded video before the start time is the part related to the application to be screen recorded.

So far, according to the start time, it can be determined that the part of the recorded video before the start time is the part related to the application to be screen-recorded. If other times are further recorded before the start time, it is necessary to further combine the other times to determine the specific range of the part related to the application to be screen recorded in the recorded video. For example, before the start time, the end time of the part of the recorded video that is not related to the application to be screen-recorded is further recorded, then, according to the end time and the start time, it can be determined that the The part between the end time and the start time in the video is the part related to the application to be screen-recorded.

If the monitored application switching event is switching from another application to the application to be screen-recorded, the recording time from the current moment to the start of recording can be recorded as the part of the recorded video that is not related to the application to be screen-recorded The end time is used to indicate that the part in the recorded video after the end time is the part related to the application to be screen recorded.

So far, according to the end time, it can be determined that the part of the recorded video after the end time is the part related to the application to be screen-recorded. If other times are further recorded after the end time, it is necessary to further combine the other times to determine the specific range of the part related to the application to be screen recorded in the recorded video. For example, after the end time, the start time of the part of the recorded video that is not related to the application to be screen-recorded is further recorded, then, according to the end time and the start time, it can be determined The part between the end time and the start time in the video is the part related to the application to be screen-recorded.

Or, for another example, the start frame number and/or the end frame of the part of the recorded video that is not related to the application to be screen recorded may be recorded according to the monitored application switching event and the application to be recorded on the screen of the terminal. No.

If the monitored application switching event is switching from the application to be screen-recorded to another application, the current frame number can be recorded as the start frame number of the part of the recorded video that is not related to the application to be screen-recorded to indicate The part before the start frame number in the recorded video is the part related to the application to be screen-recorded.

So far, according to the start frame number, it can be determined that the part before the start frame number in the recorded video is the part related to the application to be recorded on the screen. If other frame numbers are further recorded before the start frame number, it is necessary to further combine the other frame numbers to determine the specific range of the part related to the application to be screen recorded in the recorded video. For example, before the start frame number, the end frame number of the part of the recorded video that is not related to the application to be recorded on the screen is further recorded. Then, it can be determined according to the end frame number and the start frame number. The part between the end frame number and the start frame number in the recorded video is the part related to the application to be screen-recorded.

If the monitored application switching event is switching from another application to the application to be screen-recorded, the current frame number can be recorded as the end frame number of the part of the recorded video that is not related to the application to be screen-recorded to indicate The part after the end frame number in the recorded video is the part related to the application to be screen-recorded.

So far, according to the end frame number, it can be determined that the part after the end frame number in the recorded video is the part related to the application to be recorded on the screen. If other frame numbers are further recorded after the end frame number, it is necessary to further combine the other frame numbers to determine the specific range of the part of the recorded video that is related to the application to be screen-recorded. For example, after the end frame number, the start frame number of the part of the recorded video that is not related to the application to be recorded on the screen is further recorded. Then, it can be determined according to the end frame number and the start frame number. The part between the end frame number and the start frame number in the recorded video is the part related to the application to be screen-recorded.

It can be understood that, the tag information of the recorded video can be further set in combination with the technical solutions in the above two implementation processes.

So far, by monitoring that the application to be screened is switched to another application, or another application is switched to the application to be recorded to mark the part of the recorded video that is related to the application to be screen-recorded or irrelevant, so as to indicate the part of the recorded video that is related to the application to be screen-recorded.

After the recording of the content that the user wants to perform screen recording is completed, the screen recording function may be turned off in response to the user's operation based on the screen recording interface, so as to terminate the screen recording of the terminal.

In the present application, after the screen recording is completed, the recorded video and the tag information of the video can be further stored for processing.

Specifically, the recorded video and the tag information of the video may be stored in the storage device of the terminal.

In a specific implementation process, the storage device of the terminal may be a slow storage device, specifically a hard disk of a computer system, or may also be a non-running memory of a mobile phone, that is, physical memory, for example, a read-only memory (Read-Only Memory) Memory, ROM) and memory card, etc., which are not particularly limited in this embodiment.

In another specific implementation process, the storage device of the terminal may also be a fast storage device, specifically the memory of the computer system, or may also be the operating memory of the mobile phone, that is, the system memory, for example, random access memory (Random Access Memory). , RAM), etc., which are not particularly limited in this embodiment.

Optionally, in a possible implementation manner of this embodiment, in 103, the recorded video may be segmented according to the tag information of the recorded video, so as to obtain information related to the application to be recorded on the screen. Then, the obtained part related to the application to be screen recorded may be synthesized to obtain a screen recording file of the application to be screen recorded.

In this implementation manner, after the screen recording is completed, all the recorded videos and their tag information can be further acquired, and the recorded videos can be identified and processed according to the tag information, and further, according to the identification processing Identify the result and perform subsequent processing.

Specifically, the recorded video may be segmented according to the tag information of the recorded video.

At this time, the recorded video can be divided into multiple segments, and the content corresponding to each segment can be determined according to the tag information corresponding to the segment as the part related to the application to be recorded on the screen, or as the part related to the application to be recorded. Unrelated parts of the screen recording app.

Then, after the recorded video is segmented, the unrelated part of the application to be screen-recorded can be filtered according to the video tag information corresponding to each segment after the segmentation process, so as to obtain a The part related to the application to be screen recorded.

For example, according to the tag information contained in each segment, each segment is judged separately to determine whether the segment is a part related to the application to be screen-recorded, or a part not related to the application to be screen-recorded. Directly delete the fragments of the part not related to the application to be screen recorded, and perform synthesis processing on the remaining fragments related to the application to be screen recorded, so as to obtain the screen recording file of the application to be screen recorded .

Further, after obtaining the screen recording file of the application to be screen recorded, the obtained screen recording file of the application to be screen recorded may be further stored.

Specifically, the obtained screen recording file of the application to be screen recorded may be stored in the storage device of the terminal.

In this embodiment, during the screen recording process of the terminal, the application switching event of the terminal is monitored, and then the recorded video is set according to the monitored application switching event and the application to be recorded on the screen of the terminal. The tag information is used to indicate the part of the recorded video that is related to the application to be screen recorded, so that the screen recording file of the application to be screen recorded can be generated according to the recorded video and the tag information of the recorded video , because the marking information indicating the part of the recorded video related to the application to be screen recorded is set in the screen recording process of the terminal, so that the application to be screen recorded is identified from the recorded video according to the marking information. The relevant part is used to synthesize the screen recording file of the application to be screen recorded, and the part irrelevant to the application to be screen recorded is filtered out, thereby effectively improving the reliability of the screen recording.

The specific implementation of this embodiment will be further described in detail below through specific application scenarios, as shown in FIG. 2 .

201. The user opens a screen recording application, and in the list of screen recording applications supported by the screen recording application, selects application A as the application to be screen recorded.

202. The user clicks the recording start control on the screen recording interface to enable the screen recording function, so as to start the screen recording of the terminal.

203. The screen recording application determines whether the application currently running on the terminal is application A, if the application currently running on the terminal is application A, execute 204; if not, for example, it is application C, execute 207.

204. The screen recording application captures frame images on the terminal screen through an API provided by the operating system according to a specified frequency, and stores the captured frame images on the terminal in the form of video.

205. The screen recording application determines whether an application switching event of the terminal is monitored, and if an application switching event of the terminal is monitored, execute 206, and if no application switching event of the terminal is monitored, continue to execute 204.

206. The screen recording application sets the end mark of the part related to application A in the recorded video at the current position in the recorded video according to the monitored application switching event and the terminal's application to be screen-recorded, that is, application A, or sets The start marker of the part of the recorded video that is not related to application A, to indicate the part of the recorded video that is related to application A.

Specifically, the screen recording application can specifically determine that the application switching event is an application switching event that is switched from application A to application B according to the monitored application switching event and application A, so that the current position in the recorded video can be set. The end marker of the portion of the recorded video that is related to application A, or the start marker of the portion of the recorded video that is not related to application A.

The recorded video is a video in which the screen recording application intercepts the frame image on the terminal screen through the API provided by the operating system according to the specified frequency, and stores the intercepted frame image in the form of video on the terminal.

207. The screen recording application sets a start position in the recorded video, and sets a start mark of a portion of the recorded video that is not related to application A, or sets an end mark of a portion of the recorded video that is related to application A.

208. The screen recording application captures frame images on the screen of the terminal through the API provided by the operating system according to the specified frequency, and stores the captured frame images on the terminal in the form of video.

209. The screen recording application determines whether the application switching event of the terminal is monitored, if the application switching event of the terminal is monitored, execute 210, and if the application switching event of the terminal is not monitored, continue to execute 208.

210. The screen recording application sets the start mark of the part related to application A in the recorded video at the current position in the recorded video according to the monitored application switching event and the terminal's application to be screen-recorded, namely Application A, or sets The end marker of the part of the recorded video that is not related to application A, to indicate the part of the recorded video that is related to application A.

Specifically, the screen recording application can specifically determine that the application switching event is an application switching event that is switched from application C to application A according to the monitored application switching event and application A, so that the current position in the recorded video can be set. The start marker of the portion of the recorded video that is related to application A, or the end marker of the portion of the recorded video that is not related to application A.

211. The screen recording application acquires the recorded video and its tag information, and performs segmentation processing on the recorded video according to the tag information of the recorded video, so as to obtain the part related to application A, and converts the obtained part related to application A. The relevant parts of phase A are synthesized to obtain the screen recording file of application A.

For example, suppose that in the recorded video, the sequential marker information is: the end marker (a1) of the part related to application A, the start marker (a2) of the part related to application A, and the end of the part related to application A mark (a3) and the start mark (a4) of the section related to application A.

Then, by dividing the recorded video, the following five segments can be obtained:

Fragment 1: the beginning of the recorded video → a1;

Fragment 2: a1→a2;

Fragment 3: a2→a3;

Fragment 4: a3→a4;

Fragment 5: a4 → end of recorded video.

After the above five segments are obtained, each segment can be judged according to the tag information contained in each segment to determine whether the segment is a part related to application A or a part not related to application A.

Fragment 1 sequentially includes the start tag and a1 of the recorded video, so this fragment 1 is the part related to application A;

Fragment 2 contains a1 and a2 in turn, so this fragment 2 is not related to application A;

Fragment 3 contains a2 and a3 in turn, so this fragment 3 is the part related to application A;

Fragment 4 contains a3 and a4 in turn, therefore, fragment 4 is a part not related to application A;

Fragment 5 includes a4 and the end marker of the recorded video in sequence, so this fragment 5 is a part related to application A.

Further, the segment 2 and segment 4 of the part not related to application A are directly deleted, and the remaining parts related to application A are segment 1, segment 3 and segment 5 are synthesized to obtain the screen of application A. record file.

212. Store the obtained screen recording file of application A on the terminal.

So far, the screen recording file of application A has been completed, and the contents contained in the screen recording file are all contents related to the running and operation of application A.

In this embodiment, in a scenario where the application to be screen-recorded of the terminal is application A, during the screen recording process of the terminal, the application switching event of the terminal is monitored, and further, according to the monitored application switching event and application switching event A, setting the tag information of the recorded video to indicate the part of the recorded video related to application A, so that the tag information of the application to be screen recorded can be generated according to the recorded video and the tag information of the recorded video The screen recording file, since the marking information indicating the part related to application A in the recorded video is set during the screen recording process of the terminal, so that the part related to application A is identified from the recorded video according to the marking information to synthesize the screen recording file of application A, and filter out the parts that are not related to application A, thereby effectively improving the reliability of the screen recording.

In addition, using the technical solution provided by the present application, without the need for the user to manually edit the recorded video, it is possible to identify the part related to the application A from the recorded video to automatically synthesize the screen recording file of the application A. Effectively improve the efficiency of screen recording.

It should be noted that, for the sake of simple description, the foregoing method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence. Because in accordance with the present application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

Another embodiment of the present application also provides a device, the device includes: one or more processors; a storage device for storing one or more programs, when the one or more programs are stored by the one or more programs Multiple processors execute, so that the one or more processors implement the screen recording method provided by any of the embodiments corresponding to FIG. 1 .

Figure 3 shows a block diagram of an exemplary computer system/server 12 suitable for use in implementing embodiments of the present application. The computer system/server 12 shown in FIG. 3 is only an example, and should not impose any limitations on the functions and scope of use of the embodiments of the present application.

As shown in FIG. 3, computer system/server 12 takes the form of a general-purpose computing device. Components of computer system/server 12 may include, but are not limited to, one or more processors or processing units 16, storage or system memory 28, and a bus 18 connecting various system components including system memory 28 and processing unit 16.

Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of a variety of bus structures. By way of example, these architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect ( PCI) bus.

Computer system/server 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by computer system/server 12, including both volatile and non-volatile media, removable and non-removable media.

System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and/or cache memory 32 . Computer system/server 12 may further include other removable/non-removable, volatile/non-volatile computer system storage media. For example only, storage system 34 may be used to read and write to non-removable, non-volatile magnetic media (not shown in FIG. 3, commonly referred to as a "hard disk drive"). Although not shown in Figure 3, a disk drive may be provided for reading and writing to removable non-volatile magnetic disks (eg "floppy disks"), as well as removable non-volatile optical disks (eg CD-ROM, DVD-ROM) or other optical media) to read and write optical drives. In these cases, each drive may be connected to bus 18 through one or more data media interfaces. System memory 28 may include at least one program product having a set (eg, at least one) of program modules configured to perform the functions of various embodiments of the present application.

A program/utility 40 having a set (at least one) of program modules 42, which may be stored, for example, in system memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other Program modules and program data, each or some combination of these examples may include an implementation of a network environment. Program modules 42 generally perform the functions and/or methods of the embodiments described herein.

The computer system/server 12 may also communicate with one or more external devices 14 (eg, keyboard, pointing device, display 24, etc.), and may also communicate with one or more devices that enable a user to interact with the computer system/server 12, and/or with any device (eg, network card, modem, etc.) that enables the computer system/server 12 to communicate with one or more other computing devices. Such communication may take place through input/output (I/O) interface 44 . Also, the computer system/server 12 may communicate with one or more networks (eg, a local area network (LAN), a wide area network (WAN), and/or a public network such as the Internet) through a network adapter 20 . As shown, network adapter 20 communicates with other modules of computer system/server 12 via bus 18 . It should be understood that, although not shown, other hardware and/or software modules may be used in conjunction with computer system/server 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, Tape drives and data backup storage systems, etc.

The processing unit 16 executes various functional applications and data processing by running the programs stored in the system memory 28 , for example, implementing the screen recording method provided by any of the embodiments corresponding to FIG. 1 .

Another embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the screen recording method provided by any of the embodiments corresponding to FIG. 1 .

In particular, any combination of one or more computer-readable media may be employed. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples (a non-exhaustive list) of computer readable storage media include: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), Erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

A computer-readable signal medium may include a propagated data signal in baseband or as part of a carrier wave, with computer-readable program code embodied thereon. Such propagated data signals may take a variety of forms including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device .

Program code embodied on a computer readable medium may be transmitted using any suitable medium including, but not limited to, wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out the operations of the present application may be written in one or more programming languages, including object-oriented programming languages - such as Java, Smalltalk, C++, but also conventional Procedural programming language - such as "C" language or similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. Where a remote computer is involved, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider to via Internet connection).

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above may refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or page components may be combined. Either it can be integrated into another system, or some features can be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware, or may be implemented in the form of hardware plus software functional units.

The above-mentioned integrated units implemented in the form of software functional units can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, and includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute parts of the methods described in the various embodiments of the present application step. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes .

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still be Modifications are made to the technical solutions recorded in the foregoing embodiments, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

A screen recording method, comprising:

During the screen recording process of the terminal, monitor the application switching event of the terminal;

According to the monitored application switching event and the application to be screen-recorded of the terminal, set the tag information of the recorded video to indicate the part of the recorded video that is related to the application to be screen-recorded;

A screen recording file of the application to be screen recorded is generated according to the recorded video and the tag information of the recorded video.
The method according to claim 1, wherein the flag information of the recorded video is set according to the monitored application switching event and the application to be screen-recorded by the terminal to indicate the difference between the recorded video and the recorded video. Before the part related to the application to be screen recorded, it further includes:

Determine the application to be screen recorded on the terminal.
The method according to claim 2, wherein the determining the application to be screen recorded by the terminal comprises:

determining the application to be screen recorded in response to the user's operation based on the list of supported screen recording applications before the screen recording process of the terminal; or

The application to be screen recorded is determined in response to the user's operation based on the application to be screen recorded during the screen recording process of the terminal.
The method according to claim 1, wherein, during the screen recording process of the terminal, monitoring the application switching event of the terminal comprises:

monitoring the running state of the application to be screen-recorded; and determining, according to the monitored running state, an application switching event of the terminal being monitored; or

monitoring the screen recording interface of the terminal; and determining an application switching event of the terminal monitored according to the detected switching of applications in the screen recording interface.
The method according to claim 1, wherein, according to the monitored application switching event and the application to be recorded on the screen of the terminal, setting the marking information of the recorded video comprises:

According to the monitored application switching event and the application to be screen-recorded of the terminal, set the flag information of the part of the recorded video related to the application to be screen-recorded; and/or

According to the monitored application switching event and the application to be screen recorded on the terminal, set the marking information of the part of the recorded video that is not related to the application to be recorded on the screen.
The method according to claim 5, wherein the setting the marking information of the part of the recorded video related to the application to be screen-recorded comprises:

setting the start marker and/or end marker of the portion of the recorded video related to the application to be screen-recorded; or

record the start time and/or end time of the portion of the recorded video related to the application to be screen-recorded; or

Record the start frame number and/or end frame number of the portion of the recorded video that is related to the application to be screen-recorded.
The method according to claim 5, wherein the setting of the marking information of the part of the recorded video that is not related to the application to be screen-recorded comprises:

setting the start marker and/or end marker of the portion of the recorded video that is not related to the application to be screen-recorded; or

Record the start time and/or end time of the portion of the recorded video that is not related to the application to be screen-recorded; or

Record the start frame number and/or end frame number of the portion of the recorded video that is not related to the application to be screen-recorded.
The method according to any one of claims 1 to 7, wherein the generating the screen recording file of the application to be screen recorded according to the recorded video and the mark information of the recorded video comprises:

performing segmentation processing on the recorded video according to the tag information of the recorded video to obtain the part related to the application to be recorded on the screen;

The obtained part related to the application to be screen recorded is synthesized to obtain a screen recording file of the application to be screen recorded.
The method according to claim 8, characterized in that, performing segmentation processing on the recorded video according to the tag information of the recorded video to obtain the part related to the application to be screen-recorded, comprising:

Perform segmentation processing on the recorded video according to the marked information of the recorded video;

According to the video tag information corresponding to each segment after the segmentation process, filtering processing is performed on the part not related to the application to be screen-recorded to obtain the part related to the application to be screen-recorded.
An electronic device, characterized in that the device comprises:

one or more processors;

storage means for storing one or more programs,

The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-9.
A computer-readable storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.