CN113552989A

CN113552989A - Screen recording method and device and electronic equipment

Info

Publication number: CN113552989A
Application number: CN202110736669.7A
Authority: CN
Inventors: 杨铠衔
Original assignee: Vivo Mobile Communication Hangzhou Co Ltd
Current assignee: Vivo Mobile Communication Hangzhou Co Ltd
Priority date: 2021-06-30
Filing date: 2021-06-30
Publication date: 2021-10-26

Abstract

The application discloses a screen recording method, a screen recording device and electronic equipment, and belongs to the technical field of communication. The problem that privacy of a user is revealed due to the fact that the electronic equipment records the screen under the condition that the screen displays privacy information can be solved. The method comprises the following steps: determining M first image frames containing privacy information from N image frames obtained by recording a display screen of the electronic equipment, wherein M and N are positive integers; performing image processing on a target image area of each of the M first image frames by using a target image processing method to obtain M target image frames, where the target image areas are: an image area corresponding to the privacy information; generating a target screen recording file based on the target image frame and the N-M image frames; wherein, the N-M image frames are: among the N image frames, the image frames other than the first image frame. The embodiment of the application is applied to a scene of recording a screen in the electronic equipment.

Description

Screen recording method and device and electronic equipment

Technical Field

The application belongs to the technical field of communication, and particularly relates to a screen recording method and device and electronic equipment.

Background

With the development of electronic equipment technology, electronic equipment such as a smart phone basically supports a screen recording function, and a user can conveniently and quickly share an operation process or result display in a screen recording mode, for example, a user can share a certain APP through screen recording or share a video in the electronic equipment through screen recording.

In the related art, in the process of recording a screen, if personal sensitive information such as an identity card number or a facial image exists in the screen, the personal sensitive information is recorded during screen recording, and if a user shares a screen recording video containing the personal sensitive information with other people, the privacy information of the user is exposed.

Therefore, the screen recording mode provided by the related technology is easy to cause the leakage risk of personal sensitive information, and the safety of the user privacy information is low.

Disclosure of Invention

The embodiment of the application aims to provide a screen recording method, a screen recording device and electronic equipment, and the problem that privacy of a user is leaked due to screen recording of the electronic equipment under the condition that privacy information of the user is displayed on a screen can be solved.

In a first aspect, an embodiment of the present application provides a screen recording method, where the method includes: determining M first image frames containing privacy information from N image frames obtained by recording a display screen of the electronic equipment, wherein M and N are positive integers; performing image processing on a target image area of each of the M first image frames by using a target image processing method to obtain M target image frames, where the target image areas are: an image area corresponding to the privacy information; generating a target screen recording file based on the target image frame and the N-M image frames; wherein, the N-M image frames are: among the N image frames, the image frames other than the first image frame.

In a second aspect, an embodiment of the present application provides a screen recording device, where the control device includes: the device comprises a determining module, a processing module and a generating module, wherein: the determining module is configured to determine M first image frames containing privacy information from N image frames obtained by recording a display screen of the electronic device, where M and N are positive integers; the processing module is configured to perform image processing on a target image area of each of the M first image frames determined by the determining module by using a target image processing method, to obtain M target image frames, where the target image area is: an image area corresponding to the privacy information; the generating module is configured to generate a target screen recording file based on the target image frame obtained by the processing module and the N-M image frames determined by the determining module; wherein the N-M image frames are: among the N image frames, the image frames other than the M first image frames.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In a sixth aspect, the present application provides a computer program product stored in a non-volatile storage medium, the program product being executed by at least one processor to implement the method according to the first aspect.

In this embodiment of the application, the screen recording device may determine, from at least one image frame obtained by recording a screen of a display screen of an electronic device, M first image frames containing privacy information, perform image processing on a target image area containing the privacy information in each first image frame by using a target image processing method to obtain a target image frame, and then generate a target screen recording file based on the M target image frames obtained after the image processing and the image frames except the M target image frames. By the method, the screen recording device can automatically identify the image frames containing the privacy information and process the images of the privacy areas of the users in the image frames, so that the privacy information of the users or other people is prevented from being exposed in the screen recording video, the privacy information is prevented from being leaked, and the information safety of the users is ensured.

Drawings

Fig. 1 is a flowchart of a screen recording method provided in an embodiment of the present application;

fig. 2 is one of schematic diagrams of an interface applied by a screen recording method according to an embodiment of the present application;

fig. 3 is a second schematic diagram of an interface applied by a screen recording method according to an embodiment of the present application;

fig. 4 is a third schematic view of an interface applied by a screen recording method according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of a screen recording device according to an embodiment of the present application;

fig. 6 is a schematic hardware structure diagram of an electronic device according to an embodiment of the present disclosure;

fig. 7 is a second schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The screen recording method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

The screen recording method provided by the embodiment of the application can be applied to a screen recording scene.

Take the example of recording the display screen of the electronic device. When a chat page displayed in a display screen is recorded, the electronic equipment records personal private contents such as contact head portraits in the chat page, so that the personal private contents of a user can be exposed in an obtained screen recording video, and if the screen recording video is seen by others or stolen by other malicious programs, the personal private contents of the user can be leaked, and the safety of private information of the user is low.

In the embodiment of the application, when a chat page displayed in a display screen is recorded, the screen recording device can automatically identify personal private contents such as a contact head portrait, a contact nickname and the like contained in an image frame obtained by recording the chat page, and adopt a target processing mode to carry out personal private contents such as the contact head portrait, the contact nickname and the like in the image frame, so that the personal private contents are not exposed in a screen recording video, and thus, the private information of a user is prevented from being leaked, and the information safety of the user is ensured.

First, the following terms referred to in the embodiments of the present application are explained:

screen recording: the screen recording is also called screen video, and means that the terminal collects image data of all or part of the screen and encodes the collected image data to obtain a video file.

Image frame: and acquiring the data of the screen to obtain image frames, wherein the image frames are the minimum units for forming the video.

The embodiment of the application provides a screen recording method, which can be applied to electronic equipment, and fig. 1 shows a flowchart of the screen recording method provided by the embodiment of the application. As shown in fig. 1, the screen recording method provided in the embodiment of the present application may include the following steps 101 to 103:

step 101: m first image frames containing privacy information are determined from N image frames obtained by recording a display screen of the electronic equipment.

Wherein M and N are positive integers.

In this embodiment of the application, the screen recording device may perform data acquisition on the display screen of the electronic device according to a preset frame rate to obtain N image frames, where the image frames may also be image data frames. Illustratively, the predetermined frame rate may be 24fps/30fps/60fps/90fps/120fps, etc.

It should be noted that, the process of acquiring data on the display screen of the electronic device to obtain N image frames may also be a process of acquiring image frames.

Optionally, in this embodiment of the application, the screen recording device may record a screen recording area in the display screen, where the screen recording area refers to an area of the display screen (i.e., a screen) where image data is collected. For example, the screen recording area may be all display areas of the display screen, or may be a partial display area in the display screen, where the partial display area may be selected or preset by a user. For example, when the user wants to record a video of the operation process of the APP1, the screen recording area may only include the display area of the application interface of the APP1, and not include the display area of the taskbar of the electronic device.

Optionally, in this embodiment of the present application, the screen recording device may perform frame-by-frame analysis on the captured image frames to determine one or more frames of images containing the user privacy information.

Optionally, in an embodiment of the present application, the privacy information includes, but is not limited to, at least one of the following: the privacy information can also be other information which the user does not want others to know in the electronic equipment, and can be specifically set according to the actual requirements of the user, and the embodiment of the application does not limit the information.

The privacy information may be privacy information of the user (i.e., the owner) or privacy information of another person. For example, there may be a photo of the user or a photo of another person in an album of the electronic device.

For example, the privacy information may be information matched with preset privacy information, or information automatically recognized according to an AI algorithm.

In one example, the screen recording device may parse each image frame obtained by screen recording, determine information in each image frame obtained by screen recording, which matches preset privacy information, and determine the information as the privacy information.

For example, the user may add or select a content option in the setting interface, and the screen recording device may determine the content option added or selected by the user as the privacy information of the user, without wishing the content option corresponding to the content appearing in the screen recording video. For example, the user may check a "personal photo" option in the setting interface, and the screen recording device may automatically recognize the content of the screen recording video that includes the "personal photo" and process the content as the privacy information.

In another example, the screen recording apparatus may analyze each image frame obtained by screen recording one by one based on an artificial intelligence (i.e., AI) algorithm and automatically identify privacy information included in the image frame obtained by screen recording.

For example, the screen recording device may analyze the screen recording video based on an artificial intelligence (i.e., AI) algorithm, and automatically recognize the content such as a personal photo and a personal address contained in the screen recording video as the privacy information.

Optionally, in this embodiment of the present application, each of the M first image frames corresponds to P target content tags. And the target content label corresponding to each first image frame is used for marking the first image frame.

For example, in the screen recording process, the screen recording device may generate a target content tag corresponding to each first image frame based on the determined first image frames. Further, the target content tag may be generated based on feature information of the privacy information in the first image frame. For example, if the privacy information in the first image frame is an identification card picture, the screen recording device may identify the identification card picture as a personalized document according to an AI algorithm, and generate a "personalized document" content tag.

The target content tag generated based on the first image frame may be one or more than one. Further, the screen recording device may analyze the privacy information in the first image frame and give a content tag associated with the privacy information in the first image frame.

For example, in a case that it is determined that a certain collected image frame contains privacy information, a floating window is popped up to prompt the user whether to generate a target content tag of the current frame, and after the user selects an "ok" button, a corresponding target content tag is generated.

Further, the content of the target content tag may also be user-defined, that is, the user may input or edit the content of the target content tag by himself. For example, in the case where a certain image frame contains an identification card photograph, the user may enter "personalized document" in a tag content input box displayed by the system, thereby setting a content tag of the private information.

For example, the first image frame target content tag may include time stamp information. The tag name is used for indicating the information type of the privacy information contained in the first image frame, and the timestamp information is a timestamp of the first image frame and is used for determining the position of the first image frame in a video file obtained by screen recording. Further, each image frame may correspond to a time stamp.

For example, in the screen recording process, if the user privacy information included in the first image frame is an identification card picture of the user, the screen recording device may obtain a time stamp ti of the first image frame, identify that the identification card picture belongs to a "personal certificate" based on an AI algorithm, and generate a tag corresponding to the first image frame based on the time stamp information and the information type.

For example, after the screen recording is started, the screen recording device may analyze the captured image frames frame by frame, determine the image frame where the privacy information is located in the image frame in the case that the privacy information is detected to be present in the image frame, and add a tag to the image frame to record the image frame containing the privacy information, thereby facilitating subsequent processing of the privacy area in the image frame.

Illustratively, in the screen recording process, the screen recording device analyzes the image content of the first image frame, obtains the position of the image area corresponding to the privacy information in the first image frame, and records the position of the image area corresponding to the privacy information, so as to facilitate subsequent processing of the image area corresponding to the privacy information.

It should be noted that, in the screen recording method provided in the embodiment of the present application, the screen recording device may determine, from each acquired frame image, M first image frames containing the privacy information of the user during the screen recording process, or may examine each image frame in the screen recording file after the image frame acquisition is finished and the screen recording file is generated, so as to determine the M first image frames containing the privacy information of the user.

Step 102: and performing image processing on a target image area of each of the M first image frames by adopting a target image processing mode to obtain M target image frames.

Wherein, the target image area is: and the image area corresponding to the private information in the first image frame.

Optionally, in this embodiment of the application, the image area corresponding to the private information in the first image frame may be: the image area in the first image frame containing the private information may be understood as an image area in one image frame in which private content is displayed.

It should be noted that, the above-mentioned one image frame is a frame image, and the one frame image is a still picture, and a plurality of continuous image frames form a moving picture, such as a video.

For example, as shown in (a) in fig. 2, an album content screen for an electronic device is taken as an example. Assuming that the album content includes the certificate content 21 of the user, since the certificate content of the user inputs the personal sensitive information of the user, in the case of recording, after capturing the picture (i.e. the first image frame) of the album content displayed on the display screen, the screen recording device may determine the area where the certificate content 21 is located in the picture, that is, the target image area.

Optionally, in this embodiment of the application, the target image processing manner includes any one of: image overlay processing mode, image replacement processing mode, mosaic processing mode, fuzzy processing mode and text replacement mode.

Illustratively, the image overlay processing method includes, but is not limited to, the following methods: and calling a preset image or a user-defined image to cover the display content of the target image area, so as to cover the privacy information originally displayed in the target image area.

Illustratively, the image replacement processing method includes, but is not limited to, the following methods: and removing the display content of the target image area, and calling a preset image or a user-defined image to display in the target image area so as to replace the originally displayed privacy information of the target image area.

Exemplary, the mosaic processing manner includes, but is not limited to, the following manners: and the screen recording device adjusts the gray scale of the target image area on the display screen, so that the mosaic is displayed in the target image area.

Illustratively, the blurring processing method includes, but is not limited to, the following methods: and adjusting the pixels corresponding to the target image area, so that the display content in the target image area is presented with certain transparency, such as semi-transparent effect.

Optionally, in this embodiment of the present application, a target image frame corresponds to a first image frame, and the target image frame may be an image frame obtained after processing the private information in the first image frame and not displaying the private information of the user.

For example, with reference to (a) in fig. 2, as shown in (b) in fig. 2, the screen recording device may display the area where the certificate content 22 is located in the screen recording picture obtained by recording the screen to the album interface in full black, specifically, the gray level of the pixel point in the image area where the certificate content 22 is located in the screen recording picture may be set to 0, so as to hide the certificate information of the user.

It should be noted that, the image area containing the user privacy information in the first image frame is processed in the target image processing manner, so that the image area does not present the user privacy information any more, and thus, the privacy information contained in the image frame obtained by screen recording is subjected to privacy removal processing, and the security of the user privacy information is improved.

Step 103: and generating a target screen recording file based on the target image frame and the N-M image frames.

Wherein, the N-M image frames are: and the image frames except the M first image frames in the N image frames.

In this embodiment of the application, the target screen recording file is a screen recording file generated based on an image frame obtained by screen recording.

Optionally, in this embodiment of the application, the screen recording device may encode a target image frame and image frames other than the target image frame in the image frames obtained by screen recording, and synthesize each encoded image frame to obtain a target screen recording file.

In an example, the screen recording device may detect whether a currently recorded image frame includes privacy information of a user in real time during an image frame acquisition process (i.e., screen recording), and perform image processing on the image frame including the privacy information of the user to obtain a processed image frame, for example, when the screen recording device acquires an ith image frame, the screen recording device may perform privacy processing on the ith image frame to obtain a processed ith image frame. And then, after the image frames are stopped to be collected (such as the whole screen recording process is finished), encoding unprocessed image frames and processed image frames in the collected image frames to obtain a target screen recording file.

In another example, the screen recording device may encode the acquired image frames after stopping acquiring the image frames (e.g., the screen recording process is finished) to generate the first screen recording file. And then, detecting whether an image frame containing the privacy information of the user exists in the first screen recording file, and carrying out image processing on the image frame containing the privacy information of the user to obtain a processed image frame. And finally, recoding the unprocessed image frame and the processed image frame in the first screen recording file to obtain a target screen recording file.

It should be noted that, in the first example, only one encoding is required from the start of screen recording to the acquisition of the screen recording file with the privacy information removed, and in the second example, two encoding are required from the start of screen recording to the acquisition of the screen recording file with the privacy information removed.

In the screen recording method provided by the embodiment of the application, the screen recording device may determine, from at least one image frame obtained by recording a screen of a display screen of the electronic device, M first image frames containing privacy information of a user, perform image processing on a target image area containing the privacy information in each first image frame by using a target image processing method to obtain a target image frame, and then generate a target screen recording file based on the M target image frames obtained after the processing and the image frames other than the M target image frames. By the method, the screen recording device can automatically identify the image frame containing the privacy information of the user, and image processing is performed on the privacy area of the user in the image frame, so that the privacy information of the user is prevented from being exposed in the screen recording video, the privacy information of the user is prevented from being leaked, and the information safety of the user is ensured.

Optionally, in this embodiment of the present application, before the step 102, the screen recording method provided in this embodiment of the present application further includes the following step a1 and step a 2:

step A1: and displaying a target content label, wherein the target content label is used for indicating the first image frame.

Step A2: and receiving a first input of the target content label from a user.

In combination with the step a1 and the step a2, the process of the step 102 may include the following steps 102 a:

step 102 a: and in response to the first input, performing image processing on the target image area by using the target image processing method.

Optionally, the screen recording apparatus may suspend or display a tag display interface with a preset transparency on the desktop page, where the target content tag and privacy information associated with the target tag content are displayed in the tag display interface, for example, list all target content tags and privacy pictures corresponding to the target content tags.

For example, after the image frame is collected, the screen recording device may obtain a target content tag generated in the collection process, and list and display the target content tag on a tag display interface, so that a user can select private information to be processed in the image frame by operating the target content tag, for example, if the user clicks and selects one target content tag, the private information corresponding to the target content tag is processed.

Further, the screen recording device can acquire the privacy information associated with the target content tag or the display content of the image area where the privacy information is located, and display the display content in association with the target content tag in the tag display interface, so that a user can visually check the content of the privacy information corresponding to the current target content tag, and whether the privacy information needs to be processed is judged.

In addition, since the target content tag includes the time stamp information of the first image frame, the video recording apparatus may determine the first image frame corresponding to the target content tag from the plurality of image frames based on the time stamp information included in the target content tag.

For example, referring to fig. 2, as shown in (a) of fig. 3, after the recording is finished, three content tags, "personal document," "personal account number," and "chat session" are listed in the tag display interface 31, and a privacy screen 32 corresponding to the "personal document," a privacy screen 33 corresponding to the "personal account number," and a privacy screen 34 corresponding to the "chat session" are listed, a corresponding check box is displayed before each content tag, and a prompt statement "below which is sensitive information, please check the content that can be included in the video" is displayed, so as to prompt the user to perform corresponding operations. In this way, the user can intuitively view all the privacy pictures in the image frame, and can check out the privacy information needing to be processed.

Optionally, the first input is used to determine a target image area that needs to be processed. It should be noted that, the user may select, through input to one or more target content tags in the at least one target content tag, the private information that needs to be processed from among the plurality of private information.

For example, the first input may be any feasible input such as a touch input, a voice input, or a gesture input.

For example, the screen recording device may determine, based on a target content tag selected by a user, a first image frame corresponding to the target content tag and an image area of the first image frame including private information, and then perform image processing on the image area in a target image processing manner.

For example, in conjunction with (a) in fig. 3, after the user can check the check box before the "personalized document" and the privacy screen 32, the image frame corresponding to the privacy screen 32 in the image frame may be located, and the image area corresponding to the privacy screen 32 in the image frame is displayed in full black, so as to avoid exposing the privacy information in the screen recording video.

Optionally, in this embodiment of the present application, before the step 102, the screen recording method provided in this embodiment of the present application further includes the following step B1:

step B1: and displaying X controls, wherein each control corresponds to an image processing mode.

With reference to the step B1, before the step 102, the screen recording method provided in the embodiment of the present application further includes the following steps C1 and C2:

step C1: a second input by the user is received.

Step C2: and responding to a second input, and performing image processing on the target image area by adopting the target image processing mode.

Wherein the second input is: inputting a target control in the X controls by a user; the target control corresponds to the target image processing mode, and X is a positive integer.

For example, the screen recording apparatus may display the X controls on the privacy processing interface, so that the user can select a processing mode for the target image area corresponding to the privacy information.

For example, the X controls may be X check boxes, and each control corresponds to one processing mode option. Further, the user can click and select a corresponding control, select a processing mode corresponding to the control, and perform image processing on the target image area through the corresponding processing mode. Further, when the target processing mode is the image replacement processing mode, the user can select the picture of the privacy area to be replaced through a picture selection control of the privacy processing interface.

For example, the second input may be any feasible input such as a touch input, a voice input, and the like, which is not limited in this embodiment of the application. For example, in a case that the control is a checkbox, the second input may be an input that the user clicks the checkbox to select the checkbox.

For example, referring to fig. 2 and fig. 3 (a), after the user can check the check box before the "personalized document" and the privacy screen 32, as shown in fig. 3 (b), the screen recording apparatus may display the corresponding privacy processing interface 35, and display text information "please select the processing mode" to prompt the user to perform the operation. The privacy processing interface 35 displays the privacy screen 32, and processing options of a "full black" processing mode, a "mosaic" processing mode, and a "custom photo replacing" processing mode, where the processing options correspond to a check box (i.e., a control). After the user clicks the check box 36 corresponding to the "all black" processing mode, as shown in fig. 2 (b), the screen recording apparatus may display an image area "all black" containing the privacy screen 32 in the image frame, so as to avoid leakage of the user privacy information.

Optionally, in this embodiment of the application, the privacy information corresponds to a target application. Illustratively, the process of step 102 may include the following step 102 b:

step 102 b: and under the condition that the target application is not matched with the preset application, performing image processing on the target image area by adopting a target image processing mode.

Illustratively, the privacy information may be a notification message in the target application. Further, the notification message is a message in a message popup window displayed in the screen recording area.

Further, the target application may be any application installed in the electronic device, such as an instant messaging APP, a news APP, a shopping APP, and the like. For example, when the target application is an instant messaging APP, when the instant messaging APP receives a new message, a message popup containing the message content of the new message is displayed on the desktop.

It should be noted that, in an electronic device, an application program typically pops up a notification interface (i.e., a message popup) of a new message on a desktop when the new message is received, for example, an instant messaging APP pops up a chat message in a popup format in an area above the desktop when the new chat message is received. Because the chat message of the user is usually private personal information, if the chat message pops up in the screen recording process, the chat message can be recorded in the screen recording video, and the chat message is leaked.

For example, the screen recording device may determine whether the recorded image frame contains the privacy information based on the current screen recording area or the acquired image frame.

In one example, the screen recording device may parse the captured image frames to determine whether the captured image frames include a message popup window to determine whether the image frames include a notification message (i.e., private information).

In another example, the screen recording apparatus may perform real-time detection on a current screen recording area during screen recording, and when a message popup window existing in the current screen recording area is captured, it may be determined that a notification message (i.e., privacy information) is included in a currently acquired image frame.

For example, the screen recording device may perform privacy elimination on an image area where a notification message is located in an image frame containing the notification message (i.e., privacy information) of an application to ensure that the notification message is not leaked.

Further, the screen recording apparatus may perform the privacy elimination process on the notification messages included in the image frames in the case where the source application (i.e., the above-described target application) and the preset application of the notification messages included in the image frames do not match.

For example, in the screen recording process, in the case that the screen recording apparatus detects that the session message of the APP1 pops up, after an image frame containing the session message is acquired, an image area in the image frame where the session message is located may be determined, and a mosaic or a full black display may be made on the image area. Thus, the security of the session message of the user is ensured.

Further, the preset application may be selected by the user or preset by the system. For example, the user may select an application (i.e., a preset application) that allows recording of the notification message in the setting interface, and then, in the screen recording process, the screen recording device does not process the notification message generated by the application that allows recording of the notification message, and for the notification message generated by an application other than the application that records the notification message, the screen recording device may perform image processing on an image area where the notification message is located.

For example, as shown in fig. 4, four application identification options corresponding to APP1, APP2, APP3, and APP4 are displayed in the screen recording setting interface 41, and a user may click an option button of each application identification option to select a corresponding option button to select an application that allows recording of a notification message, for example, after the user selects the option button corresponding to APP1, it is described that a notification message of APP1 may be recorded in a screen recording video.

It should be noted that, in the screen recording method provided in the embodiment of the present application, the execution main body may be a screen recording device, or a control module in the screen recording device for executing the screen recording method. In the embodiment of the present application, a screen recording device is taken as an example to execute a screen recording method, and the screen recording device provided in the embodiment of the present application is described.

An embodiment of the present application provides a screen recording device, as shown in fig. 5, the control device 600 includes: a determining module 601, a processing module 602, and a generating module 603, wherein: the determining module 601 is configured to determine, from N image frames obtained by recording a display screen of the electronic device, M first image frames containing privacy information of a user, where M and N are positive integers; the processing module 602 is configured to perform image processing on a target image area of each of the M first image frames determined by the determining module 601 by using a target image processing method, to obtain M target image frames, where the target image areas are: an image area corresponding to the privacy information; the generating module 603 is configured to generate a target screen recording file based on the target image frame obtained by the processing module 601 and the N-M image frames determined by the determining module 602; wherein the N-M image frames are: among the N image frames, the image frames other than the M first image frames.

Optionally, in this embodiment of the present application, the apparatus 600 further includes: a display module 605 and a receiving module 605, wherein: the display module 604 is configured to display a target content tag, where the target content tag is used to indicate the first image frame; the receiving module 605 is configured to receive a first input of the target content tag displayed 604 by the display module from a user; the processing module 602 is specifically configured to perform image processing on the target image area in response to the first input received by the receiving module 605 by using the target image processing method;

optionally, in this embodiment of the present application, the display module 604 is further configured to display X controls, where each control corresponds to an image processing manner, and X is a positive integer; the receiving module 605 is further configured to receive a second input from the user; the processing module 602 is further configured to perform image processing on the target image area in response to the second input received by the receiving module 605 by using the target image processing method;

wherein the second input is: inputting a target control in the X controls by a user; the target control corresponds to the target image processing mode.

Optionally, in this embodiment of the present application, the privacy information corresponds to a target application; the processing module 602 is specifically configured to, when the target application is not matched with a preset application, perform image processing on the target image area by using the target image processing method.

In the screen recording device provided in the embodiment of the application, the screen recording device may determine, from at least one image frame obtained by recording a screen of a display screen of an electronic device, M first image frames containing privacy information of a user, perform image processing on a target image area containing the privacy information in each first image frame by using a target image processing method to obtain a target image frame, and then generate a target screen recording file based on the M target image frames obtained after the processing and the image frames other than the M target image frames. By the method, the screen recording device can automatically identify the image frame containing the privacy information of the user, and image processing is performed on the privacy area of the user in the image frame, so that the privacy information of the user is prevented from being exposed in the screen recording video, the privacy information of the user is prevented from being leaked, and the information safety of the user is ensured.

The screen recording device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The screen recording device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The screen recording device provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to fig. 4, and is not described here again to avoid repetition.

Optionally, as shown in fig. 6, an electronic device 700 is further provided in this embodiment of the present application, and includes a processor 701, a memory 702, and a program or an instruction stored in the memory 702 and executable on the processor 701, where the program or the instruction is executed by the processor 701 to implement each process of the foregoing screen recording method embodiment, and can achieve the same technical effect, and no further description is provided here to avoid repetition.

It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.

Fig. 7 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 100 includes, but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

Those skilled in the art will appreciate that the electronic device 100 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 7 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.

The processor 110 is configured to determine M first image frames containing privacy information of a user from N image frames obtained by recording a display screen of the electronic device, where M and N are positive integers; the processor 110 is configured to perform image processing on a target image area of each of the M first image frames determined by the processor 110 by using a target image processing method, so as to obtain M target image frames, where the target image areas are: an image area corresponding to the privacy information; the processor 110 is configured to generate a target screen recording file based on the target image frame obtained by the processor 110 and the N-M image frames determined by the processor 110; wherein the N-M image frames are: among the N image frames, the image frames other than the M first image frames.

Optionally, in an embodiment of the present application, the display unit 106 is configured to display a target content tag, where the target content tag is used to indicate the first image frame; the user input unit 107 is configured to receive a first input of the target content tag displayed by the display unit 106 from a user; the processor 110 is specifically configured to perform image processing on the target image area in response to the first input received by the user input unit 107 by using the target image processing method;

optionally, in this embodiment of the present application, the display unit 106 is further configured to display X controls, where each control corresponds to one image processing manner, and X is a positive integer; the processor 110 is further configured to receive a second input from the user; the processor 110 is further configured to perform image processing on the target image area in response to the second input received by the processor 110 by using the target image processing method;

Optionally, in this embodiment of the present application, the privacy information corresponds to a target application; the processor 110 is specifically configured to perform image processing on the target image area by using the target image processing method when the target application is not matched with a preset application.

In the electronic device provided in the embodiment of the application, the screen recording device may determine, from at least one image frame obtained by recording a screen of a display screen of the electronic device, M first image frames containing privacy information of a user, perform image processing on a target image area containing the privacy information in each first image frame by using a target image processing method to obtain a target image frame, and then generate a target screen recording file based on the M target image frames obtained after the processing and the image frames other than the M target image frames. By the method, the screen recording device can automatically identify the image frame containing the privacy information of the user, and image processing is performed on the privacy area of the user in the image frame, so that the privacy information of the user is prevented from being exposed in the screen recording video, the privacy information of the user is prevented from being leaked, and the information safety of the user is ensured.

It should be understood that, in the embodiment of the present application, the input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics Processing Unit 1041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 109 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 110 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above-mentioned screen recording method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above-mentioned screen recording method embodiment, and can achieve the same technical effect, and for avoiding repetition, the description is omitted here.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

The embodiment of the present application provides a computer program product, which is stored in a non-volatile storage medium and executed by at least one processor to implement the processes of the above-mentioned screen recording method embodiment, and can achieve the same technical effect.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A screen recording method, the method comprising:

determining M first image frames containing privacy information from N image frames obtained by recording a display screen of the electronic equipment, wherein M and N are positive integers;

performing image processing on a target image area of each of the M first image frames by using a target image processing mode to obtain M target image frames, where the target image areas are: an image area corresponding to the privacy information;

generating a target screen recording file based on the target image frame and the N-M image frames;

wherein the N-M image frames are: among the N image frames, image frames other than the first image frame.

2. The method of claim 1, wherein before performing image processing on the target image region of the first image frame in the target image processing mode, the method further comprises:

displaying a target content tag indicating the first image frame;

receiving a first input of the target content label from a user;

the image processing of the target image area of the first image frame by adopting the target image processing mode comprises the following steps:

and responding to the first input, and performing image processing on the target image area by adopting the target image processing mode.

3. The method according to claim 2, wherein before performing the image processing on the target image region by using the target image processing method, the method further comprises:

displaying X controls, wherein each control corresponds to an image processing mode, and X is a positive integer;

before the image processing is performed on the target image area by using the target image processing method, the method further includes:

receiving a second input of the user;

responding to the second input, and performing image processing on the target image area by adopting the target image processing mode;

wherein the second input is: inputting a target control in the X controls by a user; and the target control corresponds to the target image processing mode.

4. The method according to claim 1, wherein the target image processing mode comprises any one of:

image overlay processing mode, image replacement processing mode, mosaic processing mode, fuzzy processing mode and text replacement mode.

5. The method of claim 1, wherein the private information corresponds to a target application;

and under the condition that the target application is not matched with the preset application, performing image processing on the target image area by adopting the target image processing mode.

6. A screen recording apparatus, the apparatus comprising: the device comprises a determining module, a processing module and a generating module, wherein:

the determining module is used for determining M first image frames containing privacy information from N image frames obtained by recording a display screen of the electronic equipment, wherein M and N are positive integers;

the processing module is configured to perform image processing on a target image area of each of the M first image frames determined by the determining module by using a target image processing manner, so as to obtain M target image frames, where the target image areas are: an image area corresponding to the privacy information;

the generating module is configured to generate a target screen recording file based on the target image frame obtained by the processing module and the N-M image frames determined by the determining module;

wherein the N-M image frames are: among the N image frames, image frames other than the M first image frames.

7. The apparatus of claim 6, further comprising: display module and receiving module, wherein:

the display module is configured to display a target content tag, where the target content tag is used to indicate the first image frame;

the receiving module is used for receiving a first input of the target content label displayed by the display module by a user;

the processing module is specifically configured to perform image processing on the target image area in response to the first input received by the receiving module by using the target image processing manner.

8. The apparatus of claim 7,

the display module is also used for displaying X controls, each control corresponds to an image processing mode, and X is a positive integer;

the receiving module is further used for receiving a second input of the user;

the processing module is further configured to perform image processing on the target image area in the target image processing manner in response to the second input received by the receiving module;

9. The apparatus of claim 6, wherein the target image processing mode comprises any one of:

10. The apparatus of claim 6, wherein the private information corresponds to a target application;

the processing module is specifically configured to perform image processing on the target image area in the target image processing manner when the target application is not matched with a preset application.

11. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the screen recording method according to any one of claims 1-5.

12. A computer-readable storage medium, on which a program or instructions are stored, which, when executed by a processor, implement the steps of the screen recording method according to any one of claims 1 to 5.