KR101961939B1 - Apparatus and method for detecting screen recoding in mobile device - Google Patents

Abstract

According to the present invention, when a screen recording is detected in a mobile device, an application having a screen recording right is extracted from an application running on the mobile device when the screen recording is detected, and registered in a whitelist And provides information indicating that the selected application's identification information and the screen of the mobile device are being recorded. Thus, personal information of a security-important user such as financial information or privacy information is illegally recorded It is possible to prevent the liquid from flowing out to the outside.

Description

[0001] APPARATUS AND METHOD FOR DETECTING SCREEN RECORDING IN MOBILE DEVICE [0002]

The present invention relates to a screen recording detection in a mobile device. More particularly, the present invention detects a screen recording in a mobile device, extracts an application having a screen recording right from among applications running on the mobile device when screen recording is detected, The application that has not been registered in the whitelist is selected and then the identification information of the selected application and the information indicating that the screen of the mobile device is being recorded are provided so that the information of the financial information, And more particularly, to a device and method for detecting a screen recording of a mobile device that can prevent personal information of a user important in security from being leaked to the outside through illegal screen recording.

In recent years, the widespread use of the Internet has led to the rapid development of wireless mobile communication technology beyond the fixed line, and in the real world, it is also possible to use mobile devices such as mobile phones, PDAs, and hand- Information retrieval became possible regardless of time and place.

In recent years, as an intelligent mobile phone that has added a computer support function to a mobile phone, the spread of mobile devices such as smart phones has been rapidly increasing. Such smart phones are capable of functioning as a personal digital assistant (PDA) Function, video playback function, etc., and various input method and touch screen are provided to provide a more convenient interface for use. In addition, with the support of the wireless Internet function, such a smartphone can be connected to the Internet and a computer and can function as a terminal such as e-mail, web browsing, fax, banking, and game. Thus, it has become a necessity of modern people and evolved into a total entertainment device It is in a trend of going.

In addition, there are operating systems for smart phones such as IOS and Android, for example, and applications that can be executed by the operating system are actively being developed.

On the other hand, in recent Android platform environment, there are many applications for recording a screen by utilizing a recording or overlay function provided by the system, and such a screen recording function can be used maliciously according to the purpose of use.

That is, for example, as shown in FIG. 1, it is possible to record a password input scene of a user without knowing the user and capture the information, or to illegally duplicate paid content reproduced on the user's mobile device as shown in FIG. And may also be used to perform surveillance or remote surveillance for taking a picture or moving picture at the screen level so as to expose private lives.

In such a case, paid content information may be leaked out, and personal information of a security-important user such as financial information or privacy information may be leaked out, causing financial or mental damages to the mobile device user.
Patent Document: Korean Published Patent No. 2011-0101030 (Published Date September 15, 2011)

delete

Accordingly, in the present invention, when a screen recording is detected in a mobile device, an application having a screen recording right is extracted from an application running on the mobile device, and registered in a whitelist among applications extracted based on a whitelist And provides information indicating that the selected application's identification information and the screen of the mobile device are being recorded. Thus, personal information of a security-important user such as financial information or privacy information is illegally recorded Which can prevent a user from being leaked to the outside through a network.

The present invention relates to a device for detecting a screen recording of a mobile device, the device comprising: a screen recording detector for detecting whether a screen of the mobile device is recorded or not; And a screen recording management unit for extracting an application having a recording right for the screen, and providing identification information about at least a part of the extracted applications and information indicating that the screen is being recorded.

In addition, when the specific API called during the recording of the screen is executed, the screen recording detector checks the value of a specific flag on the platform of the mobile device whose value changes according to the execution of the specific API, .

In addition, the screen recording detector may call a specific API necessary for the screen recording, and may determine that the screen is being recorded if the specific API call fails.

In addition, the screen recording detection unit detects whether the recording is performed in real time or at predetermined time intervals.

In addition, the screen recording detection unit detects whether or not the recording is performed when a predetermined specific application among the applications installed on the mobile device is executed.

Further, the specific application is an application for processing personal information of a user.

In addition, the screen recording management unit is characterized in that the at least a part of the extracted applications is an application not registered in a whitelist having an application list classified as not malicious code.

The screen recording management unit may display identification information on at least a part of the extracted application and information indicating that the screen is being recorded on the screen or output it as a voice or an alarm.

In addition, the screen recording management unit may stop the execution of the extracted application corresponding to the user's selection or stop the recording right of the extracted application after providing the information indicating that the screen is being recorded .

According to another aspect of the present invention, there is provided a method of detecting a screen recording of a mobile device, the method comprising: detecting whether a screen of the mobile device is recorded; collecting information of an application running on the mobile device when the screen is being recorded; A step of extracting an application having a recording right for the screen among the running applications by analyzing the right information of the application and a step of extracting identification information about at least a part of the extracted applications and information .

The detecting step may include checking a value of a specific flag on a platform of the mobile device, the value of which is changed in association with the execution of the specific API, when a specific API called upon recording of the screen is executed, And determining that the screen is being recorded if the value of the specific flag is a predetermined value indicating that the screen is to be recorded.

The detecting step may include calling a specific API necessary for recording the screen and determining that the screen is being recorded if the specific API call fails.

In addition, the checking of the value of the specific flag and the calling of the specific API are performed in real time or at predetermined time intervals.

The detecting may be performed when a predetermined application of the application installed on the mobile device is executed.

The providing step may further include the steps of: comparing the extracted application with a whitelist having a list of applications determined not to be malicious code; and comparing the extracted application with the at least a part of the extracted applications Identifying the identified application as an application performing the recording on the screen, and providing information indicating that the identified application and the screen are being recorded.

In addition, the providing step may display identification information on at least a part of the extracted application and information indicating that the screen is being recorded on the screen, or output it as a voice or an alarm.

According to the present invention, there is an advantage that personal information of a security-important user such as financial information or privacy information can be prevented from being leaked out through illegal screen recording.

In addition, there is an advantage that the privacy infringement of the individual user due to the screen leakage of the unauthorized recorded mobile device and the mental and financial damage can be prevented.

FIG. 1 and FIG. 2 are exemplary screens of a mobile device that has been leaked through screen recording in a conventional mobile device.
FIG. 3 is a detailed block diagram of a mobile device implementing a screen recording detection apparatus according to an embodiment of the present invention. Referring to FIG.
4 is a detailed block diagram of a screen recording detection apparatus according to an embodiment of the present invention.
FIG. 5 is a flowchart illustrating an operation control of a screen recording detection apparatus according to an embodiment of the present invention.

Hereinafter, the operation principle of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions of the present invention, and these may be changed according to the intention of the user, the operator, or the like. Therefore, the definition should be based on the contents throughout this specification.

3 is a detailed block diagram of a mobile device in which a screen recording detection apparatus according to an embodiment of the present invention is implemented. Such a mobile device may include, for example, a smart phone, a tablet PC, and the like. In an embodiment of the present invention, a mobile device such as a smart phone is described as an example for convenience of description, but the present invention is not limited thereto.

Hereinafter, referring to FIG. 3, a screen recording detection operation is performed to prevent personal information of a security important user such as financial information, paid content information, or privacy information from being leaked through illegal screen recording with each component of the mobile device Will be described in detail.

First, the key input unit 300 may include a plurality of numeric keys and function keys for requesting various operations of the mobile device. When the user presses a predetermined key, corresponding key data is generated and output to the control unit 306 . The key input unit 300 has a character arrangement difference by manufacturer and country. In addition, the key input unit 300 may be displayed in a touch screen format on the display unit 304 whenever necessary in place of a physical keypad.

The communication unit 302 is connected to the Internet through a wired network or a wireless network to perform data transmission / reception.

The display unit 304 displays various kinds of information of the mobile device under the control of the control unit 306 and receives and displays the key data generated by the key input unit 300 and various information signals of the control unit 306.

The control unit 306 controls the overall operation of the mobile device according to an operation program stored in the memory unit 308. The above operation program connects the display unit 304 and the key input unit 300 as well as a basic operating system necessary for the operation of the terminal and manages the input / output of data, ), And the like are referred to collectively as software that is pre-programmed at the time of manufacture.

The screen-recording-detecting apparatus 310 detects whether a recording operation is performed on a screen on which a pay content on display or a user's personal information is displayed in the mobile device. Such detection of recording is to prevent important information displayed on the mobile device from being leaked through screen recording while the user does not recognize it. Such detection of recording may be implemented to be performed in real time, Or may be implemented to be periodically performed at intervals. In addition, the detection of recording may be performed by detecting an application of a predefined classification such as various financial applications processing personal information or financial information on a mobile device by an interrupt method and performing the detection at a corresponding time point .

In this case, as a method of detecting the screen recording in the screen recording detection apparatus 310, a specific flag on the system may be checked or a specific API (Application Programming Interface) related to screen recording may be called to check whether the corresponding API call is failed In this screen recording detection method, a detailed block configuration of the screen recording detection apparatus 310 will be described later with reference to FIG. 4.

If it is detected that the screen of the mobile device is being recorded, the screen recording detection device 310 extracts the application having the recording right for the screen among the applications running on the mobile device, And information indicating that the screen of the mobile device is being recorded.

At this time, the screen recording detection apparatus 310 may not provide identification information for all extracted applications having a recording right, and may select and provide only applications that are not whitelisted among the extracted applications.

In addition, the screen recording detection device 310 may display identification information on the extracted application and information indicating that the screen is being recorded on the entire screen or a partial area on the screen of the mobile device, or output it as voice or alarm, But is not limited thereto.

Accordingly, it is possible for the user of the mobile device to recognize the identification information of the application suspected to be performing the screen recording operation against the user's intention and the fact that the screen recording is being performed, so that illegal screen recording can be coped with.

4 is a detailed block diagram of a screen recording detection apparatus 310 according to an embodiment of the present invention. The screen recording detection unit 400, the screen recording management unit 402, the white list 404, And the like.

Hereinafter, operation of each component of the apparatus for detecting a screen recording 310 according to an embodiment of the present invention will be described in detail with reference to FIG.

First, the screen recording detection unit 400 detects whether a recording operation is performed on a screen displayed on the display unit 104 in the mobile device. Such detection of recording is to prevent important information displayed on the mobile device from being leaked through screen recording while the user does not recognize it. Such detection of recording may be implemented to be performed in real time, Or may be implemented to be periodically performed at intervals. In addition, the detection of whether recording is performed may be performed at the time when an application for processing personal information or financial information important to the mobile device is executed.

At this time, in detecting whether a screen recording operation is performed on the mobile device, the screen recording detector 400 checks the value of a specific flag implemented on the platform of the mobile device, It is possible to detect whether or not it is being recorded. For example, in a mobile device equipped with an Android platform, a specific API supporting recording of a screen on the display unit 104 of the mobile device is provided. When an application having a recording right is executed and a screen of the mobile device is recorded, The same specific API is called to perform recording on the screen of the mobile device. At this time, when the specific API is called and executed, there is a specific flag that changes its value in cooperation with the execution of the specific API on the platform of the mobile device. The value of the specific flag is different depending on execution of the API . ≪ / RTI >

Accordingly, when the value of the specific flag is checked, the screen recording detector 400 can easily detect whether the screen of the mobile device is being recorded. At this time, this specific flag may be, for example, "Display.FLAG_PRESENTATION" in the case of the Android platform, but is not limited thereto.

In addition, when checking whether the above-described recording operation is being performed, the screen recording detector 400 calls a specific API supporting recording of a screen displayed on the display unit 104 of the mobile device by another method, It is possible to check whether or not the call of the specific API fails and to detect whether the screen of the current mobile device is being recorded. For example, in a mobile device equipped with an Android platform, a specific API supporting the screen recording is not called when one application first calls the specific API and is used. Therefore, It can detect whether or not.

Accordingly, the screen recording detector 400 calls a specific API supporting recording of a screen displayed on the display unit 104 of the mobile device, and when the calling of the API fails, it is determined that the screen of the mobile device is being recorded can do. In this case, for example, when the specific API as described above is called from the system, a method called 'createVirtualDisplay ()' of the MediaProjection object is called. The screen recording detection unit 400 calls the method 'createVirtualDisplay () , and an exception (error) occurs, it can be determined that the screen of the mobile device is being recorded, but the present invention is not limited thereto.

Next, when it is detected that the screen of the mobile device is being recorded through the screen recording detection unit 400, the screen recording management unit 402 extracts the application having the recording right for the screen among the applications running on the mobile device Identification information on the extracted application, and information indicating that the screen of the mobile device is being recorded.

That is, if it is detected that the screen of the current mobile device is recorded on the screen recording detector 400, the screen recording management unit 402 provides identification information on all applications having the recording right among the applications running on the mobile device can do. In this case, a large amount of information may be provided when there are a large number of applications having a recording right, but the user can check information about all applications suspected of performing screen recording against his / her intention.

At this time, the screen recording management unit 402 can display identification information on the extracted application and information indicating that the screen is being recorded on the entire screen or a part of the screen of the mobile device, or output it as voice or alarm, But is not limited thereto.

On the other hand, as another embodiment, the screen recording management unit 402 may use a whitelist 404 storing a list of applications determined not to be malicious code among the recording right applications, It is possible to selectively provide identification information for an application that is likely to be illegally performing screen recording in the application.

That is, the screen recording management unit 402 does not provide identification information for all applications having a recording right, which is being executed at the time when it is determined that the screen is detected, It is possible to extract and provide only the applications that are not registered in the malicious code. In this case, it is possible to more easily identify whether or not the application for which the user is currently performing the recording operation is an illegal application, as compared with providing all of the identification information for the unspecified number of the recording right applications, It is possible to more easily determine whether or not the recording operation is being performed. At this time, the application registered in the whitelist 404 may be an application that the user of the mobile device registers by himself / herself because it is determined that the user can secure the security.

In addition, the screen recording management unit 402 identifies an application that is not registered in the whitelist 404 as an application that performs screen recording, provides information indicating that the screen of the current mobile device is currently being recorded, In response to the user's selection, the user may stop or stop the recording right of the application.

FIG. 5 illustrates a flow of operation control in a screen recording detection apparatus according to an embodiment of the present invention. Referring to FIG. Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 3 to 5. FIG.

First, the screen recording detection apparatus 310 detects whether a recording operation is being performed on a screen displayed on the display unit 104 of the mobile device (S500). Such detection of recording is to prevent important information displayed on the mobile device from being leaked through screen recording while the user does not recognize it. Such detection of recording may be implemented to be performed in real time, Or may be implemented to be periodically performed at intervals. In addition, the detection of recording may be performed by detecting an application of a predefined classification such as various financial applications processing personal information or financial information on a mobile device by an interrupt method and performing the detection at a corresponding time point .

In this case, in detecting whether or not the above screen recording is being performed, the screen recording detection device 310 may be configured such that, when a specific API supporting recording of a screen on the platform of the mobile device is called and executed, It is possible to detect whether or not the screen recording is performed by inspecting the value of the specific flag set to be changed so that the value is interlocked. In addition, the screen recording detection device 310 may detect whether a screen is recorded by calling a specific API supporting the recording of the screen and checking whether the calling of the corresponding API fails.

If the screen recording detection device 310 determines that the screen of the mobile device is being recorded, the screen recording detection device 310 collects information about the application being executed in the mobile device (S502), and stores the right information for each application (S504).

In addition, based on the analysis of the application-specific rights information, the screen-recording-detecting apparatus 310 can display an application having a recording right capable of performing recording on a screen displayed on the display unit 104 of the mobile device, (S506).

Then, the screen recording detection apparatus 310 detects a white list 404, which is a list of applications determined not to be malicious, from among the recording permission applications, (S508), and provides identification information of the selected application and information indicating that the screen of the current mobile device is being recorded, as a screen recording detection result (S510).

At this time, the identification information of the selected application and the information indicating that the screen of the current mobile device is being recorded may be displayed on the entire area or a partial area on the screen of the mobile device, or output as voice or alarm, It is not. It is highly likely that the application not registered in the whitelist 404 illegally records the screen of the mobile device against the user's intention. Thus, by providing the identification information of the application not registered in the whitelist 404, It is easier to judge whether screen recording is being performed against the user's intention.

Then, the screen recording detection device 310 detects that the screen of the mobile device is currently being recorded, and displays a process menu such as a permission stop, an execution stop, and the like for the application for which the identification information is provided to the user, If the user decides that the screen recording operation of the application provided with the identification information is an illegal operation against his / her intention from the screen recording detection device 310, And may request appropriate action for the application (S512).

In response to the selection input by the user, the screen recording detection device 310 may stop the recording right of the corresponding application or suspend the execution of the corresponding application, thereby preventing an illegal screen recording operation by the unauthorized application (S514).

As described above, according to the present invention, when a screen recording is detected in a mobile device, an application having a screen recording right is extracted from an application running on the mobile device when screen recording is detected, And provides information indicating that the selected application's identification information and the screen of the mobile device are being recorded so that the personal information of a user important in security such as financial information or privacy information It is possible to prevent illegal screen recording from being leaked to the outside.

3, at least the control unit 306 and the screen-recording-detecting apparatus 310 may be a program or an application stored in a recording medium and executed by a processor.

Combinations of the steps of each flowchart attached to the present invention may also be performed by computer program instructions. These computer program instructions may be loaded into a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus so that the instructions, which are executed via a processor of a computer or other programmable data processing apparatus, Lt; / RTI > These computer program instructions may also be stored in a computer usable or computer readable memory capable of directing a computer or other programmable data processing apparatus to implement the functionality in a particular manner so that the computer usable or computer readable memory It is also possible to produce manufacturing items that contain instruction means for performing the functions described in each step of the flowchart. Computer program instructions may also be stored on a computer or other programmable data processing equipment so that a series of operating steps may be performed on a computer or other programmable data processing equipment to create a computer- It is also possible for the instructions to perform the processing equipment to provide steps for executing the functions described in each step of the flowchart.

In addition, each step may represent a module, segment, or portion of code that includes one or more executable instructions for executing the specified logical function (s). It should also be noted that in some alternative embodiments, the functions mentioned in the steps may occur out of order. For example, the two steps shown in succession may in fact be performed substantially concurrently, or the steps may sometimes be performed in reverse order according to the corresponding function.

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention. Accordingly, the scope of the invention should not be limited by the described embodiments but should be defined by the appended claims.

400: Screen recording detection unit 402: Screen recording management unit
404: Whitelist

Claims (18)

delete A screen recording detection unit for detecting whether or not the screen of the mobile device is recorded,
Extracting an application having a recording right for the screen from an application running on the mobile device when it is detected that the screen is being recorded; identifying information about at least a part of the extracted applications; And a screen recording management unit for providing information for notifying the user of the information,
Wherein the screen recording detection unit comprises:
A screen recording detection unit for detecting whether or not the recording is performed by inspecting a value of a specific flag on the platform of the mobile device whose value is changed according to execution of the specific API, .
A screen recording detection unit for detecting whether or not the screen of the mobile device is recorded,
Extracting an application having a recording right for the screen from an application running on the mobile device when it is detected that the screen is being recorded; identifying information about at least a part of the extracted applications; And a screen recording management unit for providing information for notifying the user of the information,
Wherein the screen recording detection unit comprises:
And calling a specific API necessary for the screen recording and determining that the screen is being recorded if the calling of the specific API fails.
The method according to claim 2 or 3,
Wherein the screen recording detection unit comprises:
And detects whether the recording is performed in real time or at predetermined time intervals.
The method according to claim 2 or 3,
Wherein the screen recording detection unit comprises:
And detects whether or not the recording is performed when a predetermined specific application among the applications installed on the mobile device is executed.
6. The method of claim 5,
The specific application,
A screen recording detector of a mobile device that is an application for processing personal information of a user.
The method according to claim 2 or 3,
The screen recording management unit,
Wherein the at least one of the extracted applications is an application not registered in a whitelist having a list of applications classified as not malicious code.
The method according to claim 2 or 3,
The screen recording management unit,
And displays identification information on at least a part of the extracted applications and information indicating that the screen is being recorded on the screen or outputs the information as voice or alarm.
The method according to claim 2 or 3,
The screen recording management unit,
Wherein the control unit stops the execution of the extracted application in response to the selection by the user after providing information indicating that the screen is being recorded or stops the recording right of the extracted application.
delete Detecting whether a screen of the mobile device is recorded on a screen,
Collecting information of an application being executed in the mobile device when the screen is being recorded;
Analyzing rights information of the application and extracting an application having a recording right for the screen among the running applications;
Providing identification information for at least a portion of the extracted application and information indicating that the screen is being recorded,
Wherein the detecting comprises:
Checking a value of a specific flag on a platform of the mobile device, the value of which is changed in association with the execution of the specific API, when a specific API called upon recording of the screen is executed;
Determining that the screen is being recorded if the value of the specific flag is a predetermined value indicating that the screen is to be recorded
The method comprising the steps of:
Detecting whether a screen of the mobile device is recorded on a screen,
Collecting information of an application being executed in the mobile device when the screen is being recorded;
Analyzing rights information of the application and extracting an application having a recording right for the screen among the running applications;
Providing identification information for at least a portion of the extracted application and information indicating that the screen is being recorded,
Wherein the detecting comprises:
Calling a specific API necessary for recording the screen;
Determining that the screen is being recorded if the call to the specific API fails;
The method comprising the steps of:
13. The method according to claim 11 or 12,
Wherein the checking of the value of the specific flag and the calling of the specific API are performed in real time or at predetermined time intervals.
13. The method according to claim 11 or 12,
Wherein the detecting comprises:
The method of claim 1, wherein the predetermined application is one of the applications installed on the mobile device.
13. The method according to claim 11 or 12,
Wherein the providing step comprises:
Comparing the extracted application with a whitelist having a list of applications determined not to be malicious code;
Identifying at least a part of the extracted applications not registered in the whitelist as an application that performs recording for the screen;
Providing identification information of the identified application and information indicating that the screen is being recorded
The method comprising the steps of:
13. The method according to claim 11 or 12,
Wherein the providing step comprises:
And displaying identification information on at least a part of the extracted applications and information indicating that the screen is being recorded on the screen or outputting it as a voice or an alarm.
13. A program stored on a computer readable medium for causing a processor to perform the method of claim 11 or 12.
12. A computer-readable medium having recorded thereon a program for causing a processor to perform the method of claim 11 or 12.

Images