WO2021159644A1

WO2021159644A1 - Screen capture management method and apparatus, and mobile terminal

Info

Publication number: WO2021159644A1
Application number: PCT/CN2020/093596
Authority: WO
Inventors: 李宏锋
Original assignee: 平安科技（深圳）有限公司
Priority date: 2020-02-11
Filing date: 2020-05-30
Publication date: 2021-08-19
Also published as: CN111327947B; CN111327947A

Abstract

The present application provides a screen capture management method and apparatus, and a mobile terminal, applicable to the technical field of data processing. The method comprises: detecting whether a currently invoked control has a first identifier; if the control has the first identifier, obtaining display pages of the control and the display size of each display page at a first frequency; creating a picture context on the basis of the display size of each display page, providing a canvas according to the picture context, and rendering each display page to the corresponding canvas to generate a rendered control picture corresponding to each display page; rendering all the control pictures obtained into an encrypted video stream according to the corresponding display sizes, and playing back the encrypted video stream; and if a screen capture instruction for the encrypted video stream is detected, obtaining the background image corresponding to the first identifier, and storing the background image as a screenshot corresponding to the screen capture instruction. Embodiments of the present application make it impossible for users to take screenshots of controls identified in applications, thereby improving information security of a mobile terminal.

Description

Screen capture management method, device and mobile terminal

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on February 11, 2020, the application number is 2020100871417, and the invention title is "a method, device and mobile terminal for screenshot management", the entire content of which is incorporated by reference In this application.

Technical field

This application belongs to the field of information security technology, and particularly relates to a screenshot management method and a mobile terminal.

Background technique

In the mobile terminal of the iOS system, the screen capture function is very convenient to use, and the user can conveniently use the screen capture function to capture and save some required information. However, the inventor realized that the convenience of the mobile terminal also greatly reduces the security of information in the mobile terminal. For example, the payment code of some payment programs and the important mail records in some mail programs are extremely easy to be intercepted and spread illegally, resulting in mobile The security of information in the terminal is greatly reduced.

technical problem

The information security in the mobile terminal is low. For example, the payment codes of some payment programs and the important mail records in some mail programs are extremely easy to be intercepted and disseminated illegally, which greatly reduces the security of the information in the mobile terminal.

Technical solutions

In view of this, the embodiments of the present application provide a screenshot management method and a mobile terminal, which can solve the problem of low information security of the mobile terminal caused by the screenshot function.

The first aspect of the embodiments of the present application provides a screenshot management method, including: detecting whether the currently called control has a first identifier; if the control has the first identifier, acquiring the control at a first frequency The display page of each display page, and the display size of each display page; create a picture context based on the display size of each display page, lay a canvas according to the picture context, and render the display page to the corresponding display page The canvas generates a rendered control picture corresponding to each display screen; renders all the control pictures obtained into an encrypted video stream according to the corresponding display size, and plays the encrypted video stream; if A screenshot instruction for the encrypted video stream is detected, a background picture corresponding to the first identifier is acquired, and the background picture is stored as a screenshot corresponding to the screenshot instruction.

A second aspect of the embodiments of the present application provides a screenshot management device, including: an identification detection module, configured to detect whether the currently called control has a first identification; and a page acquisition module, configured if the control has the The first identifier acquires the display page of the control and the display size of each display page at a first frequency; the picture rendering module is used to create a picture context based on the display size of each display page, according to The picture context lays a canvas, and the display page is rendered to the corresponding canvas, and a rendered control picture corresponding to each display screen is generated; a video stream conversion module is used to convert all the obtained controls The picture is rendered into an encrypted video stream according to the corresponding display size, and the encrypted video stream is played; the screenshot processing module is configured to obtain the corresponding first identifier if a screenshot instruction for the encrypted video stream is detected And store the background image as a screenshot corresponding to the screenshot instruction.

A third aspect of the embodiments of the present application provides a mobile terminal. The mobile terminal includes a memory and a processor. The memory stores a computer program that can run on the processor, and the processor executes: Whether the currently called control has the first identifier; if the control has the first identifier, the display page of the control and the display size of each display page are acquired at the first frequency; based on each The display size of the display page creates a picture context, lays a canvas according to the picture context, and renders the display page to the corresponding canvas, and generates a rendered control picture corresponding to each display screen; All the control pictures obtained are rendered as encrypted video streams according to the corresponding display size, and the encrypted video stream is played; if a screenshot instruction for the encrypted video stream is detected, the corresponding first identifier is obtained And store the background image as a screenshot corresponding to the screenshot instruction.

A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, including: a computer program is stored, wherein the computer program is executed by a processor to implement the screenshot management as described in any one of the above-mentioned first aspects Method steps.

The fifth aspect of the embodiments of the present application provides a computer program product, which when the computer program product runs on a mobile terminal, causes the mobile terminal to execute the screenshot management method described in any one of the above-mentioned first aspects.

Beneficial effect

The embodiment of the present application prevents the user from taking screenshots of the controls identified in the application program, thereby improving the information security of the mobile terminal.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only of the present application. For some embodiments, for those of ordinary skill in the art, other drawings may be obtained based on these drawings without creative labor.

FIG. 1 is a schematic diagram of the implementation process of the screenshot management method provided by Embodiment 1 of the present application.

Fig. 2 is a schematic diagram of the implementation process of the screenshot management method provided in the second embodiment of the present application.

FIG. 3 is a schematic diagram of the implementation process of the screenshot management method provided in the third embodiment of the present application.

Fig. 4 is a schematic structural diagram of a screenshot management device provided in the fourth embodiment of the present application.

FIG. 5 is a schematic diagram of a mobile terminal provided in Embodiment 5 of the present application.

Embodiments of the present invention

In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are proposed for a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from obstructing the description of this application.

In order to illustrate the technical solutions described in the present application, specific embodiments are used for description below.

In order to facilitate the understanding of the application, the embodiments of the application are briefly described here, considering that the screenshot function of the mobile terminal of the iOS system is very convenient to use, making the information of the mobile terminal extremely easy to be illegally intercepted and disseminated, and the information security is greatly reduced.

In order to improve information security, an optional method is to directly install a configuration file in the mobile terminal to prohibit the screenshot function in the mobile terminal, so that the user cannot take screenshots of any display content of the mobile terminal, although it can improve the information of the mobile terminal. Security, but it will also directly cause users to be unable to use mobile terminal applications normally.

In order to effectively improve the information security of the mobile terminal, the digital rights management function supported by the iOS system is used in the embodiments of this application. The video stream is converted and the video stream is encrypted and played. When the screen capture instruction is detected, the digital rights management is used to stop the capture of the video stream content, and at the same time, the preset background image is set as the corresponding screenshot, so that the user cannot Take screenshots of the controls identified in the application. Therefore, this embodiment of the present application can implement control-level functional management of the screenshot function, and can customize the screenshot management of the controls according to different security requirements, for example, it can only be targeted at the application Some controls containing sensitive information are identified, such as only the payment code display controls in the payment program, etc., so as to improve the information security of the mobile terminal while minimizing the need for users to use the application program normally. Interference to ensure the normal use of the application by users.

Among them, the embodiment of this application does not limit the specific controls for adding identification. The technician can select and add identification according to the needs of actual applications. For example, it is possible to only control some controls containing sensitive information in each application as in the above example. Add the logo, or you can select the controls for each application according to the actual security level requirements of different applications. If the security level of the video playback program is low, you can only involve users in it. Add logos to the controls of private information, such as the controls corresponding to the playback record. If the security level of the payment program is higher, you can add logos to all the controls of the payment program, so as to achieve high-security screenshot management.

At the same time, it can be seen from the above description that the execution subject of the screenshot management method in the embodiment of the present application is a mobile terminal using the iOS system. The specific type of the mobile terminal is not limited here and needs to be determined by the specific actual application scenario requirements. Mobile terminals that can be selected for scenario requirements include, but are not limited to, mobile phones, tablets, smart watches, and robots that use iOS systems in the field of artificial intelligence.

The embodiments of the present application are described in detail as follows: FIG. 1 shows a flowchart of the screenshot management method provided in the first embodiment of the present application.

S101: Detect whether the currently called control has a first identifier.

It can be seen from the above description that the embodiment of the present application will pre-add the identification of the application control that needs to perform screenshot management. Therefore, the embodiment of the present application only needs to perform the first identification detection on the application control currently used by the user. Among them, the embodiment of this application does not limit the specific type of the first identifier, which can be set by the technicians themselves. For example, a set of specific character strings can be set as the first identifier, such as the character string 0000. At this time, only the current control needs to be detected. Whether it has a 0000 logo or not.

S102: If the control has a first identifier, obtain the display page of the control and the display size of each display page at the first frequency.

When the control has the first identifier, it means that the control needs to perform screenshot management. At this time, the embodiment of the application will obtain the content of the display page output by the control and convert it into an encrypted video stream for playback. Specifically: the embodiment of the application will use the first frequency interval Obtain the display page of the control to obtain the raw materials required for the video stream frame picture. At the same time, in order to ensure that the output encrypted video stream can accurately restore the control display page, so as to reduce the impact on the normal use of the user's application, the embodiment of this application will also Obtain the display size of each display page while obtaining the display page. Among them, the specific value of the first frequency is not limited here, and can be set by a technician according to actual needs, for example, it can be set to 20 to 90 frames per second.

It should be particularly noted that, since the embodiment of this application will finally replace the control display page in the form of playing an encrypted video stream to be displayed on the mobile terminal display screen, that is, for the user, what he sees is not the content of the real control display page. , But the content of the encrypted video stream played after the video stream conversion. Therefore, in the embodiment of this application, the display page of the control is not necessarily displayed on the display screen. That is, the display page of the control does not mean that the control is actually on the display screen. The displayed page content refers to the page content that the control actually needs to be displayed on the display screen.

As an embodiment of this application, considering one aspect of practical applications, the lower the first frequency, the smaller the workload of converting and encrypting the video stream, but the refresh frequency of the control display page content will be lower, making the video stream content and The real-time synchronization of the actual control display page content is poor, and the response speed to user operations is slow. At the same time, too low frequency will cause the video stream frame rate to be too low, making the user unable to view the video stream normally, and thus making the user unable to use it normally. For applications, on the other hand, the higher the first frequency, the higher the refresh frequency of the control display page, the real-time synchronization and the response speed to user operations, so that users can get better viewing results, but at the same time It also takes up a lot of processor resources, causing a greater impact on the use of the mobile terminal, and may even cause application freezes. Therefore, a reasonable frequency value range is extremely important to the embodiments of the present application. In this embodiment, in order to balance the workload of video stream conversion, the response speed to user operations, and the display effect of the video stream, the value range of the first frequency is set to 20-60 frames per second.

S103, creating a picture context based on the display size of each display page, laying a canvas according to the picture context, rendering the display page to the corresponding canvas, and generating a rendered control picture corresponding to each display screen.

After obtaining the required display page and display size, the embodiment of the present application will perform image rendering on the obtained display page to obtain the frame pictures required to convert the video stream. The operation steps are all the same, so here only the operation of a single display page is used as an example to describe step S103, which is described in detail as follows: In order to ensure that the generated control image has the same size as the corresponding display page, the embodiment of the present application first The picture context is created according to the display size of the display page, and then the canvas is laid out based on the created picture context, and finally the entire display page is rendered into the canvas to obtain the rendered control picture. Among them, CGContextRef can be used to create the picture context and lay out the canvas.

As a specific implementation of rendering the control picture in the embodiment, the process of rendering the control picture includes: importing the display page into the corresponding canvas, and obtaining the rendered control picture from the canvas through the UIGraphicsGetImageFromCurrentImageContext function.

S104: Render all the obtained control pictures into an encrypted video stream according to the corresponding display size, and play the encrypted video stream.

In the embodiment of this application, the essence of rendering the video stream is to use the control picture as the frame picture, according to the time sequence when the control picture is generated, the corresponding display size is taken as the real-time size of the video stream frame picture, and the first frequency is taken as the video stream frame rate. The video stream is generated, but because the digital rights management function only performs screenshot management on the encrypted video stream, the embodiment of this application also needs to encrypt the generated video stream in real time on the basis of the above operations to obtain the required Encrypt the video stream, and when playing, only need to decrypt the encrypted video stream for playback. Among them, the embodiments of the present application do not limit the specific video stream encryption methods, which can be selected or set by the technicians according to actual needs, and may also refer to the related descriptions in the second to fifth embodiments of the present application.

As an embodiment of this application, EXT-X-KEY can be used to describe the encryption key of the video stream, which indicates that the current video stream has been encrypted by digital rights, and the proxy method of the AVFoundation framework is used to determine the current video stream content during playback. Whether to support playback, and when it supports playback, play the encrypted video stream.

As an optional embodiment of the present application, in order to accurately restore the control display page of the encrypted video stream, the playback position of the display page on the display screen is also accurately restored in this embodiment. Specifically, in the basis of the first embodiment of the present application As mentioned above, this embodiment also obtains the specific location area of each display page in the display screen, and outputs the frame picture to the location area of the corresponding display page when the encrypted video stream is played. For example, assume that display page A is full screen Display, that is, the location area is full screen. At this time, the corresponding frame picture in the encrypted video stream will also be output in full screen on the display. It is also assumed that the display page B is displayed in a floating window in the middle of the display. At this time, the corresponding frame in the encrypted video stream is displayed. The frame picture will also be output in the floating window of the corresponding area in the middle of the display.

It should be understood that the conversion of the display page to the video stream in the embodiment of this application is a real-time and continuous operation, that is, when the video stream conversion is performed on the display page of the control, every time a single display page is obtained, image rendering will be performed. And video stream conversion operations. At the same time, because the embodiment of the application will continue to acquire the display page at the first frequency, combined with S102, S103, and S104, the embodiment of the application can achieve the acquisition of the real-time display page of the control, and realize the The real-time video stream conversion of the display page realizes real-time playback of the content of the display page of the control in the format of an encrypted video stream, ensuring the normal use of the control by the user.

S105: If a screenshot instruction for the encrypted video stream is detected, a background picture corresponding to the first identifier is obtained, and the background picture is stored as a screenshot corresponding to the screenshot instruction.

On the basis of completing the real-time conversion and output of the above-mentioned encrypted video stream, if the user manually triggers the screenshot function, or illegal elements trigger the screenshot function through plug-ins, etc., the mobile terminal will generate or receive a screenshot instruction for the encrypted video stream being played. At this time, the digital rights management function will be triggered synchronously, that is, the video control will be directly displayed blank, so that the obtained screenshot is also a blank picture, thereby realizing the effective protection of the control display information.

Among them, considering that if you save a blank picture directly as a screenshot, on the one hand, some users may not accept this unreachable result, making the user experience poor, and on the other hand, it cannot serve as a warning to users to pay attention to information security. Therefore, in this embodiment of the application, a background picture is preset to replace the blank picture directly generated by digital rights management. The specific content contained in the background picture is not limited here, and can be set by the technician according to actual needs. It can be a blank picture or a picture that contains some warnings. For example, you can add a warning message of "In order to protect your privacy, you can’t take a screenshot here" on the basis of the blank picture, so as to warn users to pay attention to the information Safety.

Among them, the above-mentioned preset background picture may be a plurality of background pictures pre-stored in a blockchain or a database, and when a background picture is needed, it may be directly obtained from the blockchain or the database.

In order to effectively improve the information security of the mobile terminal, the embodiment of the application makes full use of the digital rights management function supported by the iOS system itself. First, the application controls that need to prevent screenshots are added in advance, and the control page with the logo is added. Perform video stream conversion and encrypt the video stream. When the user's screen capture instruction is detected, digital rights management is used to stop the capture of the video stream content, and the preset background image is set as the corresponding screenshot at the same time. This makes it impossible for the user to take screenshots of the controls identified in the application. Therefore, the embodiments of the present application can implement control-level functional management of the screenshot function. For different security requirements, the control screenshots can be customized for the control, for example, only for Some controls in the application that contain sensitive information are identified, such as only the payment code display controls in the payment program, etc., which can improve the information security of the mobile terminal while minimizing the normal use of users. The interference of the application program guarantees the normal use of the application program by the user.

As a specific implementation of the encrypted video stream conversion of the control picture in the first embodiment of this application, considering that the first embodiment of this application is the real-time video stream conversion of the control display page, it is necessary to display the real-time display page content to For the user, it is necessary to ensure that the control can respond to the user's operation in real time. Therefore, the time-consuming requirement for the entire encrypted video stream conversion is extremely high. At the same time, since the encrypted video stream needs to be decrypted during playback, the Among them, if the video stream encryption takes a long time, it will inevitably lead to longer time-consuming conversion and playback of the entire encrypted video stream, which will have a large time delay impact on the display of the control display page and the response of user operations, thereby affecting the user’s application The normal use of the program.

Therefore, in order to shorten the time-consuming conversion of the encrypted video stream and reduce the impact on the user's normal use of the application, as shown in FIG. 2, in the second embodiment of the present application, the specific steps of performing the encrypted video stream conversion on the control picture are: Including the following steps.

S201: Render the obtained control picture as an unencrypted video stream according to the corresponding display size.

Refer to the operation description of rendering the video stream in S104, which is not repeated here.

S202: Obtain a first character string with a length of n and only containing numbers, and use the numbers at each position of the first character string as the number of encryption intervals in turn, and generate an encryption interval sequence containing n numbers of encryption intervals, where n is positive Integer.

After obtaining the unencrypted video stream, start to encrypt the real-time unencrypted video stream. Considering that the time-consuming requirements for video stream encryption in practical applications are extremely high, in order to reduce the encryption time, this embodiment of the application chooses to encrypt only part of the frame pictures in the unencrypted video stream, because it is not necessary to operate on all the frame pictures. , Which greatly reduces the workload of the encryption operation and reduces the time-consuming encryption. Specifically: the embodiment of the present application first obtains a first character string with a length of n and only containing numbers, where the first character string can be either It is pre-set by a technician, or it can be generated according to a certain generation rule, which is not limited here. After the first character string is obtained, each number in the first character string is used as an encryption interval number. The encryption interval number is used to determine the next selection after selecting the frame picture that needs to be encrypted. For frame pictures, for example, assuming that the number of encryption intervals corresponding to frame picture A to be selected is 1, after frame picture A is extracted, the embodiment of the present application will extract the frame picture after an interval of one picture after frame picture A. By taking each number as the number of encryption intervals and sorting them in order, the corresponding encryption interval sequence can be obtained. For example, assuming that the first character string is 135, the corresponding encryption interval sequence {1, 3, 5} can be obtained at this time.

S203: According to the number of n encryption intervals in the encryption interval sequence, sequentially select the frame pictures to be encrypted in the unencrypted video stream at intervals.

After the encryption interval sequence is obtained, this embodiment of the application will start to select the frame picture of the unencrypted video stream. Specifically, the first frame picture of the unencrypted video stream is taken as the first extracted frame picture, and then according to the encryption interval sequence The first encryption interval number in determines the next extracted frame picture and extracts it. After the extraction is completed, the next frame picture is extracted according to the next encryption interval number, and the frame picture extraction is repeated according to the number of encryption intervals The operation can realize real-time extraction of the frame pictures that need to be encrypted in the embodiment of the present application. An example is as follows: Suppose the encryption interval sequence is {1, 3, 5}. At this time, after the first frame picture of the unencrypted video stream is extracted, frame picture extraction is performed at intervals of 1 frame picture, that is, unencrypted video is extracted After the extraction is completed, the third frame picture of the stream is extracted, and then the frame picture is extracted at 3 intervals, that is, the 7th frame picture of the unencrypted video stream is extracted. Encrypt the 13th frame picture of the video stream, so as to realize the extraction of the frame picture to be encrypted.

It should be noted that the embodiment of this application does not limit the conditions for terminating extraction of frame pictures, which can be set by technicians according to actual needs, including but not limited to, such as setting to stop extraction when all the encryption intervals in the sequence are exhausted. , Set to stop when the extracted frame pictures reach a certain threshold, or set to reuse the number of encryption intervals in the sequence until the output of the unencrypted video stream is completed.

As a specific implementation of obtaining the first character string in the second embodiment of the present application, considering that as the number of encrypted frame pictures decreases, the security of encryption will also decrease. Therefore, in order to reduce the workload of encryption (ie The number of encrypted frame pictures is less than the total number of frame pictures in the video stream) while ensuring the security of encryption. In this embodiment of the application, a method of randomly generating the first character string is used, so that the specific encrypted frame pictures cannot be predicted. To further improve the security of encryption, random encryption methods include: randomly generating a length n, and randomly generating a first string of length n that contains only numbers.

In the embodiment of the present application, the length and content of the first character string are completely randomly generated, so that the encrypted frame picture each time is unpredictable, which greatly increases the difficulty of finding the encrypted frame picture when cracking, making the encrypted frame picture Security can be improved.

S204: Encrypt the selected frame pictures to obtain an encrypted video stream.

After extracting the required encrypted frame pictures, the embodiment of the application encrypts these frame pictures to realize the encryption protection of the unencrypted video stream. The specific encryption method is not limited here, and the technical personnel can follow The actual requirements are selected or set, including, but not limited to, using some reversible algorithms to blur the frame picture, as well as segmenting and shuffling the frame picture content area.

In the embodiment of the application, the encrypted interval sequence is converted by using the first character string, and the unencrypted video stream is extracted according to the number of encryption intervals in the encrypted interval sequence, and finally the extracted frame pictures are encrypted, so that the video stream is encrypted The process only needs to process the frame pictures in the video stream, which reduces the workload of encryption, makes the encryption faster, and ensures the real-time efficiency of encrypted video stream conversion.

As a specific implementation of frame picture extraction in the second embodiment of this application, considering that the user’s operation duration on the control cannot be predicted in actual applications, that is, the duration of the unencrypted video stream cannot be predicted, so the number of encryption intervals generated in a single time The number does not necessarily meet the needs of encryption.

In order to meet the encryption requirements of different durations of unencrypted video streams, the embodiment of the application will cyclically use the encryption interval numbers in the encryption interval sequence, so that each encryption interval number can be used repeatedly, and the sequence numbers of the n encryption interval numbers in the encryption interval sequence are sequentially As shown in Fig. 3, in the embodiment of the present application, the step of extracting frame pictures specifically includes: S301, selecting the number of encryption intervals in sequence from small to large according to the sequence number, and based on each Select the number of encryption intervals, and select the frame pictures to be encrypted in the unencrypted video stream at intervals.

For the frame picture selection operation here, reference may be made to the description in the second embodiment of the present application, which will not be repeated here.

S302: If the selected sequence number of the encryption interval number is n, set the sequence number of the next selected encryption interval number to 1, and return to perform the operation of sequentially selecting the encryption interval numbers according to the sequence number from small to large.

In the embodiment of the present application, each time the encryption interval number in the encryption interval sequence is used up, the encryption interval sequence is re-used for subsequent frame picture selection operations, so as to realize the repeated use of each encryption interval number. At this time, regardless of the duration of the unencrypted video stream, the embodiment of the present application can continuously perform frame image selection operations to meet actual encryption requirements.

As an embodiment of the present application, considering that both the second and third embodiments of the present application only perform encryption processing on part of the frame pictures of the unencrypted video stream, for the finally generated encrypted video stream, only part of it is The frame pictures are encrypted. If the number of these encrypted frame pictures is very small, even if the encrypted video stream is played directly, the encrypted video stream can be viewed normally, which makes the effect of encryption extremely poor and cannot guarantee the reliability and information of encryption. Security.

In order to ensure the reliability of encryption and the security of information, this embodiment of the application sets the frame rate of the video stream and the encryption interval, so that if the encrypted video stream is played directly without decryption, it will result in encryption. The video stream cannot be viewed normally. In the embodiment of the present application, first, the operation of obtaining the first frequency specifically includes: randomly generating a first frequency greater than or equal to 20 frames/sec and less than 40 frames/sec.

On the basis that the first frequency is greater than or equal to 20 frames/sec and less than 40 frames/sec, the obtaining operation of the first character string in this embodiment of the present application includes: obtaining the first character string with a length of n and only containing the number 1.

When the video frame rate is lower than 20 frames per second, the human body will not be able to watch the video content normally. Therefore, in the embodiment of the present application, the lower limit of the first frequency is set to 20 frames per second to ensure the decryption. The video stream can be viewed normally. At the same time, since the interval sampling limit is to collect every other frame, that is, at most 50% of the frame pictures of the unencrypted video stream can be encrypted. Therefore, the upper limit of the first frequency is set in the embodiment of this application. The value is set to less than 40 frames per second, and at the same time, the numbers of the first string are all set to 1, so that in the encrypted video stream, the number of unencrypted frame pictures output per second will not exceed 20, which is In the case of decryption, even if the encrypted video stream is played directly, the user cannot watch the video stream content normally, that is, the encrypted video stream must be decrypted before it can be watched normally, which greatly improves the reliability of encryption and guarantees the security of mobile terminal information sex.

Corresponding to the method of the above embodiment, FIG. 4 shows a structural block diagram of a screenshot management device provided in an embodiment of the present application. For ease of description, only the parts related to the embodiment of the present application are shown. The screenshot management apparatus illustrated in FIG. 4 may be the execution subject of the screenshot management method provided in the first embodiment.

4, the screenshot management device includes: an identification detection module 41, configured to detect whether the currently called control carries a first identification.

The page obtaining module 42 is configured to obtain the display page of the control and the display size of each display page at a first frequency if the control has the first identifier.

The picture rendering module 43 is configured to create a picture context based on the display size of each display page, lay a canvas according to the picture context, and render the display page to the corresponding canvas to generate each Display the rendered control picture corresponding to the screen.

The video stream conversion module 44 is configured to render all the obtained control pictures into an encrypted video stream according to the corresponding display size, and play the encrypted video stream.

The screenshot processing module 45 is configured to, if a screenshot instruction for the encrypted video stream is detected, obtain a background picture corresponding to the first identifier, and store the background picture as a screenshot corresponding to the screenshot instruction.

Further, the picture rendering module 43 includes: importing the display page into the corresponding canvas, and obtaining the rendered control picture from the canvas through the UIGraphicsGetImageFromCurrentImageContext function.

Further, the video stream conversion module 44 includes: a video rendering module, configured to render the obtained control picture into an unencrypted video stream according to the corresponding display size.

Interval acquisition module, for acquiring a first character string of length n and containing only numbers, and taking the numbers at each position of the first character string as the number of encryption intervals in turn, to generate an encryption including n of the number of encryption intervals Interval sequence, where n is a positive integer.

The picture selection module is configured to sequentially select the frame pictures to be encrypted in the unencrypted video stream at intervals according to the number of n encryption intervals in the sequence of encryption intervals.

The encryption module is used to encrypt the selected frame pictures to obtain the encrypted video stream.

Further, the interval obtaining module includes: randomly generating a length n, and randomly generating a first character string with a length n and containing only numbers.

Further, the screenshot management device further includes: a frequency acquisition module, configured to randomly generate the first frequency greater than or equal to 20 frames/sec and less than 40 frames/sec.

The interval obtaining module includes: obtaining a first character string with a length of n and only containing the number 1.

Further, the sequence numbers of the n encryption interval numbers in the encryption interval sequence are 1, 2, ..., n, and the picture selection module includes: sequentially selecting the encryption interval numbers according to the sequence number from small to large , And based on the number of encryption intervals selected each time, the frame pictures to be encrypted in the unencrypted video stream are selected at intervals.

If the selected sequence number of the encryption interval number is n, set the sequence number of the next selected encryption interval number to 1, and return to execute the sequence of selecting the encryption interval number in order from small to large. Operation.

For the process by which each module in the screenshot management device provided in the embodiment of the present application realizes their respective functions, please refer to the description of the first embodiment shown in FIG. 1 for details, which will not be repeated here.

It should be understood that the size of the sequence number of each step in the foregoing embodiment does not mean the order of execution. The execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

It should be understood that when used in the specification and appended claims of this application, the term "comprising" indicates the existence of the described features, wholes, steps, operations, elements and/or components, but does not exclude one or more other The existence or addition of features, wholes, steps, operations, elements, components, and/or collections thereof.

It should also be understood that the term "and/or" used in the specification and appended claims of this application refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations.

As used in the description of this application and the appended claims, the term "if" can be construed as "when" or "once" or "in response to determination" or "in response to detecting ". Similarly, the phrase "if determined" or "if detected [described condition or event]" can be interpreted as meaning "once determined" or "in response to determination" or "once detected [described condition or event]" depending on the context ]" or "in response to detection of [condition or event described]".

In addition, in the description of the specification of this application and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance. It should also be understood that although the terms “first”, “second”, etc. are used in the text in some embodiments of the present application to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, the first table may be named the second table, and similarly, the second table may be named the first table without departing from the scope of the various described embodiments. The first form and the second form are both forms, but they are not the same form.

The reference to "one embodiment" or "some embodiments" described in the specification of this application means that one or more embodiments of this application include a specific feature, structure, or characteristic described in combination with the embodiment. Therefore, the sentences "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless it is specifically emphasized otherwise. The terms "including", "including", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

As an example and not a limitation, when the terminal device is a wearable device, the wearable device may also be a general term for using wearable technology to intelligently design daily wear and develop wearable devices. A wearable device is a portable device that is directly worn on the body or integrated into the user's clothes or accessories. Wearable devices are not only a kind of hardware device, but also realize powerful functions through software support, data interaction, and cloud interaction. In a broad sense, wearable smart devices include full-featured, large-sized, complete or partial functions that can be implemented without relying on smart phones, such as smart watches or smart glasses, and only focus on a certain type of application function, and need to be used in conjunction with other devices such as smart phones. , Such as various smart bracelets for physical sign monitoring.

FIG. 5 is a schematic structural diagram of a mobile terminal provided by an embodiment of the present application. As shown in FIG. 5, the mobile terminal 5 of this embodiment includes: at least one processor 50 (only one is shown in FIG. Computer program 52. When the processor 50 executes the computer program 52, the steps in the above embodiments of the screenshot management method are implemented, for example, steps 101 to 105 shown in FIG. 1. Alternatively, when the processor 50 executes the computer program 52, the functions of the modules/units in the foregoing device embodiments, such as the functions of the modules 41 to 65 shown in FIG. 4, are realized.

The mobile terminal 5 may be a mobile computing device such as a tablet computer and a mobile phone. The mobile terminal may include, but is not limited to, a processor 50 and a memory 51. Those skilled in the art can understand that FIG. 5 is only an example of the mobile terminal 5, and does not constitute a limitation on the mobile terminal 5. It may include more or less components than those shown in the figure, or a combination of certain components, or different components. For example, the mobile terminal may also include an input sending device, a network access device, a bus, and the like.

The so-called processor 50 may be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processors) Signal Processor, DSP), Application Specific Integrated Circuit (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

The memory 51 may be an internal storage unit of the mobile terminal 5 in some embodiments, such as a hard disk or a memory of the mobile terminal 5. The memory 51 may also be an external storage device of the mobile terminal 5, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), and a secure digital (Secure Digital, SD) equipped on the mobile terminal 5. Card, Flash Card, etc. Further, the memory 51 may also include both an internal storage unit of the mobile terminal 5 and an external storage device. The memory 51 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program. The memory 51 can also be used to temporarily store data that has been sent or will be sent.

In addition, the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

The embodiments of the present application also provide a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in each of the foregoing method embodiments can be realized. Wherein, the computer-readable storage medium may be non-volatile or volatile.

The embodiments of the present application provide a computer program product. When the computer program product runs on a mobile terminal, the steps in the foregoing method embodiments can be realized when the mobile terminal is executed.

If the integrated module/unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiments and methods, and can also be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the program is executed by the processor, it can implement the steps of the foregoing method embodiments. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (Read-Only Memory, ROM) , Random Access Memory (Random Access Memory, RAM), electrical carrier signal, telecommunications signal, and software distribution media, etc.

In the above-mentioned embodiments, the description of each embodiment has its own focus. For parts that are not described in detail or recorded in an embodiment, reference may be made to related descriptions of other embodiments.

A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, a person of ordinary skill in the art should understand that it can still implement the foregoing The technical solutions recorded in the examples are modified, or some of the technical features are equivalently replaced; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the application, and should be included in Within the scope of protection of this application.

Claims

A screenshot management method, which includes:

Detect whether the currently called control has the first identifier;

If the control has the first identifier, acquiring the display page of the control and the display size of each display page at a first frequency;

Create a picture context based on the display size of each display page, lay a canvas according to the picture context, and render the display page to the corresponding canvas, and generate a rendered image corresponding to each display screen Control picture;

Rendering all the obtained control pictures into an encrypted video stream according to the corresponding display size, and playing the encrypted video stream;

If a screenshot instruction for the encrypted video stream is detected, a background picture corresponding to the first identifier is obtained, and the background picture is stored as a screenshot corresponding to the screenshot instruction.
8. The screenshot management method of claim 1, wherein the rendering the display page to the corresponding canvas and generating the rendered control picture corresponding to each display screen comprises:

Import the display page into the corresponding canvas, and obtain the rendered control picture from the canvas through the UIGraphicsGetImageFromCurrentImageContext function.
The screenshot management method according to claim 1, wherein said rendering all the obtained control pictures into an encrypted video stream according to the corresponding display size comprises:

Rendering the obtained control picture into an unencrypted video stream according to the corresponding display size;

Obtain a first character string with a length of n and only containing numbers, and use the numbers at each position of the first character string as the number of encryption intervals in sequence to generate an encryption interval sequence containing n of the number of encryption intervals, where n Is a positive integer;

According to the number of n encryption intervals in the sequence of encryption intervals, sequentially select the frame pictures to be encrypted in the unencrypted video stream at intervals;

Encrypting the selected frame pictures to obtain the encrypted video stream.
8. The screenshot management method according to claim 3, wherein said obtaining the first character string containing only numbers comprises:

Randomly generate a length of n, and randomly generate a first string of length n that contains only numbers.
8. The screenshot management method of claim 3, wherein before said obtaining the display page of the control at the first frequency, the method further comprises:

Randomly generating the first frequency greater than or equal to 20 frames/sec and less than 40 frames/sec;

The obtaining the first string of length n and containing only numbers includes:

Get the first string with length n and only containing the number 1.
The screenshot management method according to any one of claims 3 to 5, wherein the sequence numbers of the n encryption intervals in the encryption interval sequence are 1, 2, ..., n, and the encryption interval sequence is The number of n encryption intervals in the interval sequence, and the selection of the frame pictures to be encrypted in the unencrypted video stream sequentially at intervals includes:

Selecting the number of encryption intervals in order of sequence numbers from small to large, and selecting the frame pictures to be encrypted in the unencrypted video stream at intervals based on the number of encryption intervals selected each time;

If the selected sequence number of the encryption interval number is n, set the sequence number of the next selected encryption interval number to 1, and return to execute the sequence of selecting the encryption interval number in order from small to large. Operation.
The screenshot management method according to claim 1, wherein said playing the encrypted video stream comprises:

Based on AVFoundation The framework determines whether the video stream content of the encrypted video stream supports playback, and plays the encrypted video stream when the playback is supported.
8. The screenshot management method according to claim 1, wherein said playing the encrypted video stream comprises:

Acquiring the position of each display page in the display screen;

Outputting the frame pictures of the encrypted video stream to a position on the display screen corresponding to each of the display pages.
The screenshot management method of claim 1, wherein if a screenshot instruction for the encrypted video stream is detected, a background picture corresponding to the first identifier is obtained, and the background picture is stored as the screenshot Screenshots corresponding to the instructions, including:

If a screenshot instruction for the encrypted video stream is detected, a blank page is played to make the screenshot corresponding to the screenshot instruction a blank picture.
A screenshot management device, which includes:

The identification detection module is used to detect whether the currently called control has the first identification;

A page obtaining module, configured to obtain the display page of the control and the display size of each display page at a first frequency if the control has the first identifier;

The picture rendering module is configured to create a picture context based on the display size of each display page, lay a canvas according to the picture context, and render the display page to the corresponding canvas to generate each display The rendered control picture corresponding to the screen;

The video stream conversion module is configured to render all the obtained control pictures into an encrypted video stream according to the corresponding display size, and play the encrypted video stream;

The screenshot processing module is configured to, if a screenshot instruction for the encrypted video stream is detected, obtain a background picture corresponding to the first identifier, and store the background picture as a screenshot corresponding to the screenshot instruction.
A mobile terminal, wherein the mobile terminal includes a memory and a processor, the memory stores a computer program that can run on the processor, and when the processor executes the computer program:

Detect whether the currently called control has the first identifier;

If the control has the first identifier, acquiring the display page of the control and the display size of each display page at a first frequency;

Create a picture context based on the display size of each display page, lay a canvas according to the picture context, and render the display page to the corresponding canvas, and generate a rendered image corresponding to each display screen Control picture;

Rendering all the obtained control pictures into an encrypted video stream according to the corresponding display size, and playing the encrypted video stream;

If a screenshot instruction for the encrypted video stream is detected, a background picture corresponding to the first identifier is obtained, and the background picture is stored as a screenshot corresponding to the screenshot instruction.
The mobile terminal according to claim 11, wherein, when the processor executes the computer program:

Import the display page into the corresponding canvas, and obtain the rendered control picture from the canvas through the UIGraphicsGetImageFromCurrentImageContext function.
The mobile terminal according to claim 11, wherein, when the processor executes the computer program:

Rendering the obtained control picture into an unencrypted video stream according to the corresponding display size;

Obtain a first character string with a length of n and only containing numbers, and use the numbers at each position of the first character string as the number of encryption intervals in sequence to generate an encryption interval sequence containing n of the number of encryption intervals, where n Is a positive integer;

According to the number of n encryption intervals in the sequence of encryption intervals, sequentially select the frame pictures to be encrypted in the unencrypted video stream at intervals;

Encrypting the selected frame pictures to obtain the encrypted video stream.
The mobile terminal according to claim 13, wherein, when the processor executes the computer program:

Randomly generate a length of n, and randomly generate a first string of length n that contains only numbers.
The mobile terminal according to claim 13, wherein, when the processor executes the computer program:

Randomly generating the first frequency greater than or equal to 20 frames/sec and less than 40 frames/sec;

The obtaining the first string of length n and containing only numbers includes:

Get the first string with length n and only containing the number 1.
The mobile terminal according to any one of claims 13 to 15, wherein the sequence numbers of the n encryption interval numbers in the encryption interval sequence are 1, 2, ..., n, and the processor executes the Realize in computer program:

Selecting the number of encryption intervals in order of sequence numbers from small to large, and selecting the frame pictures to be encrypted in the unencrypted video stream at intervals based on the number of encryption intervals selected each time;

If the selected sequence number of the encryption interval number is n, set the sequence number of the next selected encryption interval number to 1, and return to execute the sequence of selecting the encryption interval number in order from small to large. Operation.
The mobile terminal according to claim 11, wherein, when the processor executes the computer program:

Based on AVFoundation The framework determines whether the video stream content of the encrypted video stream supports playback, and plays the encrypted video stream when the playback is supported.
The mobile terminal according to claim 11, wherein, when the processor executes the computer program:

Acquiring the position of each display page in the display screen;

Outputting the frame pictures of the encrypted video stream to a position on the display screen corresponding to each of the display pages.
The mobile terminal according to claim 11, wherein, when the processor executes the computer program:

If a screenshot instruction for the encrypted video stream is detected, a blank page is played to make the screenshot corresponding to the screenshot instruction a blank picture.
A computer-readable storage medium storing a computer program, wherein the computer program implements the steps of the method according to any one of claims 1 to 9 when the computer program is executed by a processor.