KR101700799B1 - User terminal of having a shoulder surfing proterction and method - Google Patents

Abstract

The present invention discloses a user terminal having a shoulder surfing prevention function and a method for preventing shoulder surfing.
A user terminal having a shoulder surfing prevention function according to an embodiment of the present invention includes a display unit, a memory for storing a shoulder anti-surfing program, and a processor for executing a program, Extracts the text of the document, applies character recombination to the text string corresponding to the gazing area and the text string corresponding to the unexposed area, respectively, based on the gazing area and the non-gazing area of the user's electronic document, And displays the applied string on the display unit.
At this time, the complexity of the character recombination for the unexposed region is set to be higher than the complexity of the character recombination for the candidate region.

Description

[0001] USER TERMINAL OF HAVING A SHOULDER SURFING PROCESS AND METHOD WITH SHOULDER SAFING PROTECTION [0002]

The present invention relates to a user terminal and method having a shoulder surfing protection function.

Recently, a document viewer program is being developed to protect electronic documents displayed on electronic devices from malicious actors. Existing document viewer programs only display electronic documents on the screen so that they can be read by users. Therefore, when a user views an electronic document, the contents of the document may be exposed to surrounding malicious actors.

As an example of a method for solving the problem, there is a physical method for preventing a malicious agent from stealing a user's screen by attaching a security film to a screen of the electronic device. The security film is a method that changes the light transmittance according to the angle of the screen of the electronic device. The transparent film is seen from the front but the transmittance is changed according to the angle when the side is over 30 degrees. can do.

 As another example, there is a software method in which a Privacy Filter Software is installed in an electronic device to prevent a malicious agent from stealing a user's screen. Privacy software can be used to steal the user's monitor screen from behind the user's shoulder. If an attack is detected, the entire screen becomes opaque so that the malicious actor can not know what screen the user is viewing.

However, since the security film must be attached to each screen of the electronic device, a cost problem arises, and when the malicious actor attacks the privacy software, the screen becomes opaque so that the user can not see the monitor.

Therefore, there is a need for a method for the user to continuously monitor the user's monitor and defend the user's screen against the attack of the malicious agent.

On the other hand, US Patent Publication No. US2011-0209053 (entitled " shuffling document containing limited information) identifies a critical section containing limited information data, and shuffles the data to generate a synthesized document A method is disclosed.

The present invention has a function of preventing a shoulder surfing from being displayed on a display of a user terminal by applying character recombination to a text string corresponding to a reference area and a text string corresponding to a non-reference area based on a user's gazing area and a non- A user terminal and method are provided.

It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may be present.

According to an aspect of the present invention, there is provided a user terminal having a shoulder anti-surfing function, comprising: a display unit; a memory for storing the shoulder anti-surfing program; And a processor for executing the program, wherein the processor extracts a text of the electronic document selected by the user in accordance with the execution of the program, and based on the gaze region and the missed region for the electronic document of the user , Character string recombination is applied to the text string corresponding to the gazing area and the text string corresponding to the non-gazing area, and the character string to which the character string is applied is displayed on the display unit.

At this time, the complexity of the character recombination for the non-gazed area is set to be higher than the complexity of the character recombination for the gaze area.

According to another aspect of the present invention, there is provided a method for preventing shoulder surfing of a user terminal, comprising: extracting a text of an electronic document selected by a user; Applying character recombination to a text string corresponding to the gazing area and a text string corresponding to the non-gazing area based on the gazing area and the non-gazing area of the electronic document of the user; And displaying the character string to which the character recombination is applied on the display unit.

At this time, the applying step sets the complexity of the non-gazed area to a high degree of complexity of character recombination to the gaze area.

According to an exemplary embodiment of the present invention, a user terminal having a shoulder surfing prevention function may search for a text string corresponding to a candidate region and a text string corresponding to an unexposed region based on a candidate region and a non- By applying character recombination, malicious actors can not identify any part of the document. Therefore, the user can continuously take a document regardless of whether or not the document is malicious.

Also, according to an embodiment of the present invention, a user terminal having a shoulder surfing prevention function and a method for preventing shoulder surfing can improve security by applying a character recombination method to text of an electronic document. Therefore, it can be applied for use in organizations that deal with a lot of documents that should not be known externally (for example, military-related organizations, institutions dealing with national secrets).

1 is a block diagram of a user terminal having a shoulder surfing prevention function according to an embodiment of the present invention.
2 is a flowchart illustrating a method for preventing shoulder surfing of a user terminal having a shoulder surfing prevention function according to an exemplary embodiment of the present invention.
3 is a diagram for explaining the complexity of character recombination according to an embodiment.
4A to 4C are views for explaining an example of a shoulder surfing prevention system proposed in the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "including" an element, it is to be understood that the element may include other elements as well as other elements, And does not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

The following examples are intended to further illustrate the present invention and are not intended to limit the scope of the present invention. Accordingly, the same scope of the invention performing the same function as the present invention will also fall within the scope of the present invention.

The present invention provides a user terminal and a method for providing different texts to a user and a malicious agent on the same screen.

That is, according to the present invention, even when the malicious attacker attacks, the user who has read the existing document still reads and understands the document, but the malicious actor can not read the document read by the user, Provides recombinant technology.

In addition, a character recombination technique for making a malicious agent unavailable can be a modified form of a technique of shuffled text method based on human's typos or ability. That is, while providing the user with the original information, the attacker uses character recombination to make it impossible to extract any information from the document. At this time, character recombination can be performed by classifying the user's gaze area and the missed area, and adjusting the complexity, which indicates the difficulty of readability, with respect to each area.

At this time, a low level of character recombination is performed for a region to be examined by a user, and a high level of character recombination can be performed for a non-gazing region other than the gazing region.

For example, if a high level of character recombination (= high complexity) is achieved, it is difficult to deduce the original text, and conversely if low level character recombination (= low complexity) is achieved, It is possible to make an analogy of the original text because it is made by the process. That is, it is reasonable that a low level of character recombination is performed for a user's gazing area, and a high level of character recombination is performed for a non-gazing area.

Hereinafter, the shoulder surfing prevention technique proposed by the present invention will be described in detail with reference to the accompanying drawings.

1 is a simplified block diagram of a user terminal having a shoulder surfing prevention function according to an embodiment of the present invention.

A user terminal 100 having a shoulder surfing prevention function according to an exemplary embodiment of the present invention includes a memory 110, a processor 120, a database 130, and a receiving unit 140. However, since the user terminal 100 having the anti-surfing function of FIG. 1 is only one embodiment of the present invention, the present invention is not limited to FIG. That is, according to various embodiments of the present invention, the user terminal 100 having the anti-surfing function may be configured differently from that of FIG. 1, further including a configuration such as a user interface device.

The user terminal 100 having the shoulder surfing prevention function can be implemented by various kinds of portable terminals or computers. Here, the portable terminal is, for example, a portable communication device with guaranteed portability and mobility, such as a Personal Communication System (PCS), a Global System for Mobile communications (GSM), a Personal Digital Cellular (PDC) PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), WiBro (Wireless Broadband Internet) Phone), and the like, for example. In addition, the computer can include, for example, a laptop, a desktop, a laptop, a tablet PC, a slate PC, and the like, each of which is equipped with a WEB Browser.

The memory 110 stores a shoulder anti-surfing program and other data. Here, the other data may be an electronic document before the character recombination is applied, or an electronic document to which character recombination is applied according to the execution of the shoulder surfing prevention program.

The shoulder anti-surfing program may include a text extraction module 112, a character recombination module 114, an output interface module 116, and a processor may be implemented through each module. The text extraction module 112 extracts the text of the electronic document selected by the user. The character recombination module 114 plays a role of applying a character recombination method to the text extracted by the text extraction module 112. The display module 116 serves to transmit information to display the text string applied through the character recombination module 114 on the display unit. At this time, the output interface module 116 controls the display unit to display text information changed according to a user's gaze area changed in real time.

The term 'module' refers to a hardware component such as software or a Field Programmable Gate Array (FPGA) or an Application Specific Integrated Circuit (ASIC), and the module performs certain roles. However, a module is not limited to software or hardware. A module may be configured to reside on an addressable storage medium and may be configured to execute one or more processors. The functionality provided by the components and modules may be combined into a smaller number of components and modules or further separated into additional components and modules.

The memory 110 may store not only the program but also various programs. The memory 110 may be a nonvolatile memory device such as a cache, a read only memory (ROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM) Or a storage medium such as a hard disk drive (HDD), a CD-ROM, or the like, but is not limited thereto.

The processor 120 performs a shoulder surfing prevention program stored in the memory 110.

The processor 120 extracts the text of the electronic document selected by the user according to the execution of the shoulder surfing prevention program and displays the text string corresponding to the reference area and the text string Character string is applied to the text string corresponding to the gazing area, and the character string to which the character string is applied is displayed on the display unit. At this time, the complexity of the character recombination for the non-gazed region is set to be higher than the complexity of the character recombination for the gaze region.

 In other words, the complexity of character recombination can be designed to have different complexity for the user's gaze area and missed area. For example, since the user's text area needs to be read by the user, the text area should be designed to have a low complexity and the text area should not be read by the user. Should be designed.

That is, character recombination is applied to the user's gazing area with low complexity, so that the text in the area of the user's gaze is easily recognized as a normal word. For example, it is possible to use a technique of rearranging vowels only for text strings, changing the sequence of words in the middle, or generating words that are easy to recognize as normal words even if the order of the characters changes. (For example, description -> description / critical -> critcial / torture -> totrure / skepticism -> skepticism). The complexity of character recombination will be described in detail with reference to FIG. 3 below.

Here, the gaze area may have a range corresponding to a preset reference, and the unexposed area may include all of the range outside the gaze area.

For example, if the user terminal is a computer, the gaze area may be a predetermined area around a mouse pointer of a mouse connected to the computer. Here, the predetermined range includes a line of text where the mouse pointer is located. At this time, it may further include a few lines before and after the corresponding line, which may be the number of lines specified according to the setting of the user.

Further, when the user terminal is a computer, the gaze area may be a predetermined area around a cursor moving through a direction key of a keyboard connected to the computer. The predetermined range includes a line of text where the cursor is located. At this time, it is possible to additionally include a few lines of lines before and after the corresponding line, which may be the number of lines specified according to the setting of the user.

In another example, when the user terminal is a portable terminal, the examination area may be a predetermined area centered on a line-of-sight position of the user traced using the camera of the portable terminal. Here, the predetermined range includes a line of text where the traced user's line of sight is located. At this time, it is possible to additionally include a few lines of lines before and after the corresponding line, which may be the number of lines specified according to the setting of the user.

On the other hand, an area other than the gazing area can be classified as a non-gazing area, and a complexity can be set to a non-gazing area step by step.

For example, the unexposed region has a region range corresponding to a predetermined pattern, and the complexity of character recombination can be applied to the region region in a stepwise manner. Here, the preset pattern can designate an area range in the form of multiple circles as an unexposed area, or designate an area range in accordance with a text line. In addition, the complexity of character recombination can be increased and increased in the range of the missed region away from the gazing region.

Processor 120 may apply character recombination on a word-by-word basis of text extracted from an electronic document upon application of character recombination. At this time, character recombination can change the order of collection of words according to the complexity.

The display unit 150 may be a monitor connected to the computer when the user terminal is a computer, and may be a liquid crystal display of the portable terminal when the user terminal is a portable terminal. The display unit 150 can display an electronic document in which the character is recombined based on the user's gaze area and the missed area.

The display unit 150 may be configured in combination with the output interface module 116 of the memory 110. At this time, the output interface module 116 may generate a control message to display changed information according to a user's gaze area changed in real time on the display.

The user can confirm the text to which the low-level character recombination is applied for the user's gazing area continuously through the display unit 150, and the text to which the high-level character recombination is applied is displayed for the non-gazing area

The method for preventing shoulder surfing of a user terminal according to an exemplary embodiment of the present invention includes extracting text of an electronic document (S210), applying character recombination (S220), and displaying the text on a display unit (S230) .

First, the text of the electronic document selected by the user is extracted (S210).

For example, the user can select any of the electronic documents stored in the user terminal, and extract the text of the electronic document for character recombination.

Next, character recombination is applied to the text string corresponding to the gazing area and the text string corresponding to the unexposed area, respectively, based on the gazing area and the non-gazing area of the electronic document of the user (S220). For example, the user's gaze area may be a predetermined area from the area where the cursor of the mouse pointer or the keyboard of the mouse is connected to the computer when the user terminal is a computer. Specifically, the predetermined area may be a line where the cursor of the mouse pointer or the key boat is located, and the range of the corresponding area may be increased according to the setting of the user.

In another example, if the user terminal is a portable terminal, the user's gaze area may be a predetermined area centered on the user's gaze position using the camera of the portable terminal. Specifically, the predetermined area may be a line where the user's line of sight is located, and the range of the corresponding area may be increased according to the setting of the user.

In addition, when the user terminal is a computer, the user's gaze area may be a predetermined area around the gaze position of the user who is traced using a webcam connected to the computer. Specifically, the predetermined area may be a line where the user's line of sight is located, and the range of the corresponding area may be increased according to the setting of the user.

In this case, the step S220 of applying the character recombination may set the complexity of the character string to the missed region to be higher than the complexity of the character string to the missed region. That is, character recombination can be performed based on a text string located in the gazing area and the unexposed area. Character recombination can be designed to have different complexities for the candidate region and the missed region. For example, since the text located in the user's gazing area needs to be read by the user, character recombination with a low level of complexity is performed, and the text located in the unexposed area does not need to be read by the user , Character recombination with a high level of complexity can be achieved.

At this time, the character recombination may be performed on a word unit or a sentence unit of the text located in the candidate region and the missed region.

The step of applying the character recombination (S220) may further include designating a region range corresponding to a predetermined pattern for the uneducation region. At this time, the complexity of character recombination may be applied to the area range step by step.

For example, the preset pattern can be set in the form of multiple circles. The non-gazed region is divided into several circle shapes. The closer to the gazing region, the lower the complexity of the character recombination, The complexity can be set higher in stages.

For example, the preset pattern can be set in the form of a text line, and the missed region is divided according to a plurality of text lines, and the complexity of character recombination is set to be closer to the text line closer to the candidate region, The complexity can be set higher step by step.

On the other hand, the designation of the gazing area and the unexposed area can be designed to be multi-level in the form of a pattern. This will be described in detail with reference to FIGS. 4A and 4B.

The character string to which the character recombination is applied is displayed on the display unit (S230).

3 is a diagram for explaining the complexity of character recombination according to an embodiment.

Referring to FIG. 3, character recombination can be applied word by word.

For example, low complexity recombination with a low level of complexity that allows the user to recognize the word is applied to the user's gaze area, and high complexity Lt; / RTI > can be applied.

In other words, the character recombination can set the complexity according to the candidate region and the missed region. Character recombination can also apply complexity on a word-by-word or sentence-by-word basis.

 For example, the gaze area may be a predetermined area where the current cursor is located on the display, and the unexposed area may be all areas other than the gaze area. In this case, the non-gazed region can be set in stages from the gazing region where the cursor is positioned, and a higher complexity word or a higher-complexity sentence can be outputted as the distance is gradually decreased.

For example, in the case of the word 'shuffled', a low complexity recombination can be achieved by recombining the order of 'l' and 'e' with 'suhffeld' for the candidate region, and 'Sufeldfh' A high degree of complexity recombination that can not infer the word 'Shuffled' can be achieved. For the words 'Text' and 'Method', character recombination can be performed with low complexity and high complexity depending on the candidate region and the missed region.

4A and 4B are views for explaining an example of a shoulder surfing prevention system proposed in the present invention.

For example, a shoulder anti-surge system may be based on tracking the user's gaze. If the user terminal is a computer or a portable terminal, a user's line of sight is tracked through a web camera or a camera mounted on the device, and a designated area is designated as a gaze area from a location where the user's gaze is located, It can be designated as a missed area. At this time, low-level character recombination can be performed on the candidate region, and the non-candidate region designates the region range according to the pre-designated pattern setting, and the higher the character region recombination is, .

For example, when the user terminal is a computer, the shoulder anti-surfing system designates the cursor of the keyboard connected to the computer or the position of the mouse pointer of the connected mouse as a user's gaze area, Can be specified. At this time, low-level character recombination can be performed on the candidate region, and the non-candidate region designates the region range according to the pre-designated pattern setting, and the higher the character region recombination is, .

The character recombination of the shoulder anti-surfing system can be applied to the word recombination (Words Tokenization) or word recombination (Randomization) method. 4A shows an example of a character recombination method.

Referring to FIG. 4A, in the case of Words Tokenization, sentence recombination is performed by tokenizing words constituting a sentence. For example, the sentence "Hi all, good morning! (2), "good" (3) "mornig" (4) Have (5), a (6) nice (7), and day (8), the sentence reorganization can be performed by changing the order of tokenization.

Here, the complexity of the sentence recombination can be determined according to the number of times the tokenized word order is changed. For example, in the case of low complexity, the sequence of words can be randomly changed and the number of times can be set to one, so that the analogy of the sentence can be easily made. In the case of high complexity, By increasing the number of times, analogy of sentences can be difficult.

Referring to FIG. 4A, in the case of word recombination (Randomization), word recombination is performed by randomizing a string constituting a word. For example, in the case of the word "morning", the text strings "m" (a), "o" (b), "r" (c), "n" e), "n" (f), and "g" (g) and changing their order.

Here, the complexity of word recombination can be determined by varying the shuffle method for a character string constituting a word. For example, in the case of low complexity, a new word that is easy to recognize as a normal word even if the sequence of vowels is changed, the order of characters in the middle is changed, or the order of characters is changed, In the case of a high complexity, it is possible to change the position of a character string constituting a word at random and adjust the number of times, thereby making analogy of the sentence difficult.

The missed area of the shoulder anti-surge system can be character-reconstructed by dividing the area range according to a predetermined pattern.

FIGS. 4B to 4C illustrate an example of specifying a region range of a missed region according to a predetermined pattern, and applying a complexity of character recombination stepwise to the region range. FIG.

Referring to FIG. 4B, the non-gazed region is set according to the pattern of the multiple circle with respect to the non-gazed region. Referring to FIG. 4B, a description will be given of a case where character recombination is applied according to a pattern of a multiple circle with respect to a original text 401 in which no character recombination is performed. Here, the gaze region 402 may be set to the center of the circle, and the unexposed region may be a multi-circle region that is gradually becoming wider from the gaze region.

For example, if the user terminal is a computer, that is, the mouse pointer or the place where the cursor of the keyboard is located can be the center of the circle. If the user terminal is a portable terminal, . At this time, the area range of the non-gazed area can be designated as the area other than the center part of the circle, and the character recombination can be performed by setting the complexity stepwise higher as the area range is farther from the center part of the circle.

Referring to FIG. 4C, a non-gazed region is set in accordance with the row pattern with respect to the non-gazed region. 4C, a description will be given of a case where character recombination is applied to the original text 401 in which character recombination is not performed according to a row pattern. Here, the gaze area 404 may be set based on a line of text that the user's gaze is gazing at, and the unexposed area may be a line other than the gaze area.

For example, if the user terminal is a computer, that is, a mouse pointer or a row in which a cursor of the keyboard is located can be designated as a gaze area. If the user terminal is a portable terminal, (404). At this time, all of the rows 405 other than the corresponding row can be designated as a missed region, and character recombination can be performed by setting the complexity to be stepwise higher as the distance from the row is increased.

In other words, a shoulder surfing system is a technique to improve the security of documents and can increase the resistance of attack from malicious actors who try to attack over the shoulder.

The user terminal and method having the shoulder surfing prevention function described above can also be implemented in the form of a recording medium including instructions executable by a computer such as a program module executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, both removable and non-removable media. The computer-readable recording medium may also include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

It is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents. .

100: User terminal with shoulder anti-surfing function
110: Memory
112: Text Extraction Module
114: character recombination module
116: output interface module
120: Processor
150: Display unit

Claims (10)

In a user terminal having a shoulder surfing prevention function,
A display unit;
A memory for storing said shoulder anti-surfing program; And
And a processor for executing the program,
Wherein the processor extracts a text of the electronic document selected by the user according to the execution of the program and generates a text string corresponding to the reference area and a text string corresponding to the electronic document based on the reference area and the non- Applying a character recombination to a text string corresponding to a missed region, displaying the character string to which the character recombination is applied on a display unit,
The complexity of the character recombination for the unexposed region is set to be higher than the complexity of the character recombination for the candidate region,
Wherein the candidate region includes a region range corresponding to a preset reference,
Wherein the unexposed region includes all of the out of the coverage area. The method according to claim 1,
Wherein the processor applies character rearrangement in word units of the text extracted from the electronic document when applying the character rearrangement,
Wherein the character recombination changes the vowel order of the words. delete The method according to claim 1,
The non-gazed region has a region range corresponding to a predetermined pattern,
Wherein the complexity of character recombination is applied stepwise to the region range. The method according to claim 1,
If the user terminal is a computer,
Wherein the gaze area is an area corresponding to a predetermined reference around a mouse pointer of a mouse connected to the computer or a cursor of a connected keyboard. The method according to claim 1,
If the user terminal is a computer,
Wherein the gaze area is located at a predetermined distance from a user traced using a webcam mounted on the computer
Wherein the predetermined region is a predetermined region centered on a line-of-sight position. The method according to claim 1,
When the user terminal is a portable terminal,
Wherein the user's gaze area is a predetermined area around a gaze position of a user traced using the camera of the portable terminal. A method for preventing shoulder surfing of a user terminal,
Extracting a text of an electronic document selected by the user;
Applying character recombination to a text string corresponding to the gazing area and a text string corresponding to the non-gazing area based on the gazing area and the non-gazing area of the electronic document of the user; And
And displaying the character string to which the character recombination is applied on a display unit,
Wherein the applying step sets the complexity for the missed region to be higher than the complexity of the character recombination for the candidate region,
Wherein the candidate region includes a region range corresponding to a preset reference,
Wherein the unexposed region includes all of the out of the coverage area. ≪ RTI ID = 0.0 > 31. < / RTI > 9. The method of claim 8,
The non-gazed region has a region range corresponding to a predetermined pattern,
Wherein applying the character recombination comprises:
And applying complexity of character recombination stepwise to the region range. A computer-readable recording medium recording a program for performing the method according to any one of claims 8 to 9 on a computer.

Images