KR20230087131A - Electronic terminal apparatus which is able to identify personal information included in the image object, which is to be inserted into an electronic document, and the operating method thereof - Google Patents

Abstract

The present invention provides an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document and an operating method thereof, thereby preventing leakage of personal information included in an image object inserted into an electronic document. there is.

Description

ELECTRONIC TERMINAL APPARATUS WHICH IS ABLE TO IDENTIFY PERSONAL INFORMATION INCLUDED IN THE IMAGE OBJECT, WHICH IS TO BE INSERTED INTO AN ELECTRONIC DOCUMENT , AND THE OPERATING METHOD THEREOF}

The present invention relates to an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document and an operating method thereof.

Recently, as electronic terminal devices such as computers, smart phones, or tablet PCs have become widely available, various types of electronic document-related programs have been released that enable users to view, create, and edit electronic documents using these electronic terminal devices. .

Such electronic document-related programs include word processors supporting basic document preparation and editing, data input, arithmetic operations, and data management assisting spreadsheets, presentation programs assisting presenters in presentations, and the like.

Users who create electronic documents using these electronic document-related programs often insert image objects into electronic documents by using image insertion functions supported by electronic document-related programs in order to make the contents of the electronic document more specific. many.

On the other hand, image objects inserted into electronic documents may contain personal information such as resident registration numbers or phone numbers. If such personal information is indiscriminately leaked to others, it may be misused for a crime. Be careful.

In this regard, in the past, in order to prevent leakage of personal information included in an image object inserted into an electronic document, a user directly identifies personal information included in an image object, and the personal information included in the image object is individually checked. After masking, the corresponding image object was often inserted into an electronic document.

However, this conventional method not only takes a lot of time, but also has a problem that the personal information included in the image object can be easily leaked to the outside if the user fails to identify the personal information included in the image object. .

If a technology capable of identifying personal information included in an image object inserted into an electronic document is introduced, leakage of personal information included in an image object inserted into an electronic document can be more efficiently prevented.

Therefore, research on a technology capable of identifying personal information included in an image object inserted into an electronic document is required.

The present invention proposes an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document and an operating method thereof, thereby preventing leakage of personal information included in an image object inserted into an electronic document. .

An electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document according to an embodiment of the present invention uses a plurality of different regular expressions preset to correspond to a display format of personal information. If an image insertion command instructing to insert a first image object at a first point in an electronic document is applied to the regular expression storage unit in which the first image object is stored, the first image A text extraction unit for performing text recognition on an object to extract text included in the first image object, and when the text included in the first image object is extracted, the regular expression storage unit among the extracted text A string checking unit for checking whether a string having a notation format corresponding to the plurality of regular expressions stored in is present, a string having a notation format corresponding to the plurality of regular expressions among the extracted text, If it is confirmed that at least one first string exists, a query message asking the user whether to insert the first image object into the electronic document despite the fact that personal information is included in the first image object. When a final image insertion command instructing to insert the first image object into the electronic document is applied by the user in response to the query message display unit generating and displaying the first image object on the screen, the electronic document and an image inserting unit inserting the first image object at the first point of the image.

In addition, an operating method of an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document according to an embodiment of the present invention corresponds to a display format of personal information, and a plurality of different regular Maintaining a regular expression storage unit in which expressions are stored, when a user applies an image insertion command instructing to insert a first image object at a first point in the electronic document, based on a preset text recognition model, extracting text included in the first image object by performing text recognition on the first image object; when the text included in the first image object is extracted, among the extracted text, the regular expression Checking whether a string having a notation format corresponding to the plurality of regular expressions stored in a storage unit exists, a string having a notation format corresponding to the plurality of regular expressions among the extracted text, If it is confirmed that at least one first string exists, a query message asking the user whether to insert the first image object into the electronic document despite the fact that personal information is included in the first image object. generating and displaying on the screen, and when a final image insertion command instructing to insert the first image object into the electronic document is applied by the user in response to the query message, the image of the electronic document and inserting the first image object at a first point.

The present invention provides an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document and an operating method thereof, thereby preventing leakage of personal information included in an image object inserted into an electronic document. there is.

1 is a diagram showing the structure of an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document according to an embodiment of the present invention.
2 to 7 are views for explaining the operation of an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document according to an embodiment of the present invention.
8 is a flowchart illustrating an operating method of an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. This description is not intended to limit the present invention to specific embodiments, but should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. While describing each drawing, similar reference numerals have been used for similar components, and unless otherwise defined, all terms used in this specification, including technical or scientific terms, are common knowledge in the art to which the present invention belongs. has the same meaning as commonly understood by the person who has it.

In this document, when a certain component is said to "include", it means that it may further include other components without excluding other components unless otherwise stated. In addition, in various embodiments of the present invention, each component, functional block, or means may be composed of one or more sub-components, and the electrical, electronic, and mechanical functions performed by each component are electronic It may be implemented with various known elements or mechanical elements such as circuits, integrated circuits, ASICs (Application Specific Integrated Circuits), and may be implemented separately or two or more may be integrated into one.

On the other hand, the blocks of the accompanying block diagram or the steps of the flowchart are computer program instructions that perform designated functions by being loaded into a processor or memory of a device capable of data processing, such as a general-purpose computer, a special purpose computer, a portable notebook computer, and a network computer. can be interpreted as meaning Since these computer program instructions may be stored in a memory included in a computer device or in a computer readable memory, the functions described in blocks of a block diagram or steps of a flowchart are produced as a product containing instruction means for performing them. It could be. Further, each block or each step may represent a module, segment or portion of code that includes one or more executable instructions for executing specified logical function(s). Also, it should be noted that in some alternative embodiments, functions mentioned in blocks or steps may be executed out of a predetermined order. For example, two blocks or steps shown in succession may be performed substantially simultaneously or in reverse order, and in some cases, some blocks or steps may be omitted.

1 is a diagram showing the structure of an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document according to an embodiment of the present invention.

Referring to FIG. 1 , an electronic terminal device 110 according to an embodiment of the present invention includes a regular expression storage unit 111, a text extraction unit 112, a string check unit 113, a query message display unit 114, and It includes an image insertion unit 115.

The regular expression storage unit 111 stores a plurality of different regular expressions preset to correspond to the display format of personal information.

Here, the regular expression means a formal language used to express a set of strings with specific rules, such as '111-2222-3333' or '123456-4567890'.

For example, the regular expression storage unit 111 may store a plurality of different regular expressions preset to correspond to the display format of personal information as shown in Table 1 below.

Notation format of personal information regular expression Mobile phone number notation format ^\d{3}-\d{3,4}-\d{4}$ Phone number notation format ^\d{2,3}-\d{3,4}-\d{4}$ Format of resident registration number ^\d{6}-\d{7}$ ... ...

When an image insertion command instructing to insert a first image object at a first point of the electronic document is applied by the user 130, the text extraction unit 112 detects the first image object on the basis of a preset text recognition model. Text recognition is performed on the image object to extract text included in the first image object. Here, the text recognition module refers to a pre-built text recognition module based on optical character recognition (OCR) technology or deep learning technology that can be obtained by recognizing text in an image or video.

When the text included in the first image object is extracted by the text extraction unit 112, the string check unit 113, among the extracted text, the plurality of regular expressions stored in the regular expression storage unit 111 Checks whether a string having a format corresponding to the expressions exists.

The query message display unit 114 is a string having a notation format corresponding to the plurality of regular expressions among the extracted text by the string confirmation unit 113, and when it is confirmed that at least one first string exists, For the user 130, a query message inquiring whether to insert the first image object into the electronic document despite personal information included in the first image object is generated and displayed on the screen.

The image inserting unit 115 responds to the query message and when a final image inserting command instructing to insert the first image object into the electronic document is applied by the user 130, the first image object of the electronic document is applied. The first image object is inserted at one point.

Hereinafter, operations of the text extraction unit 112, the character string confirmation unit 113, the query message display unit 114, and the image insertion unit 115 will be described in detail, for example.

First, it is assumed that an image insertion command instructing to insert 'image object 1' at a first point of an electronic document is applied to the electronic terminal device 110 by the user 130 .

At this time, it is assumed that 'image object 1' is the same as the picture indicated by reference numeral 210 in FIG. 2 .

Then, the text extractor 112 performs text recognition on 'Image Object 1 (210)' based on a preset text recognition model, and converts the text included in 'Image Object 1 (210)' into 'Hong Gil-dong'. , Contact: 010-1234-5678' text can be extracted.

Then, the string check unit 113 selects the plurality of regular expressions stored in the regular expression storage unit 111 as shown in Table 1 among the extracted texts such as 'Hong Gil-dong, contact: 010-1234-5678'. It is possible to check whether a string having a format corresponding to the .

In relation to this, referring to the regular expression storage unit 111 as shown in Table 1, comparing the extracted text and the plurality of regular expressions, the string indicated by reference numeral 211 among the extracted text is 'mobile phone'. It can be confirmed that it has a notation format corresponding to 'number notation format'.

Therefore, the string checking unit 113 can confirm that the string 211 exists as a string having a notation format corresponding to the plurality of regular expressions in the extracted text.

Then, the query message display unit 114 asks the user 130 whether or not to insert the 'image object 1 210' into the electronic document even though personal information is included in the 'image object 1 210'. A query message to be queried may be created and displayed on the screen.

At this time, it is assumed that a command to insert a final image instructing to insert 'image object 1 (210)' into the electronic document is applied to the electronic terminal device 110 by the user 130 in response to the query message. .

Then, the image insertion unit 115 may insert 'image object 1 210' at the first point of the electronic document.

According to an embodiment of the present invention, the electronic terminal device 110 may further include a dummy image generator 116 and a masking processor 117 .

After the first image object is inserted at the first point of the electronic document by the image insertion unit 115, the dummy image generator 116 determines the information about the first image object by the user 130. When a masking processing command is applied, a dummy image having the same size as the first image object is created.

At this time, according to an embodiment of the present invention, the dummy image generator 116 has a specific configuration for generating the dummy image, and includes an authentication matrix storage unit 117, a reference image storage unit 118, and a password setting request unit. 119, a vector extraction unit 120, an operation matrix generation unit 121, and a dummy image generation processing unit 122.

In the authentication matrix storage unit 117, an authentication matrix having a size of n (n is a natural number greater than or equal to 2) x n composed of '1' and '0' components is stored.

'과 같은 '3 x 3' 크기의 인증 행렬이 저장되어 있을 수 있다.For example, when n is '3', the authentication matrix storage unit 117 '

An authentication matrix having a size of '3 x 3' such as ' may be stored.

The reference image storage unit 118 stores a first reference image pre-specified as corresponding to the '1' component and a pre-specified second reference image as corresponding to the '0' component.

For example, it is assumed that 'reference image 1', which is pre-specified as corresponding to the component of '1', is the same as the picture indicated by reference numeral 310 in FIG. 3, and 'reference image 2', which is pre-specified as corresponding to the component of '0' If it is the same as the figure indicated by reference numeral 320 of 3, 'reference image 1 310' and 'reference image 2 320' may be stored in the reference image storage unit 118.

After the first image object is inserted at the first point of the electronic document by the image inserting unit 115, the password setting request unit 119 provides information about the first image object by the user 130. When the masking processing command is applied, a password setting request message requesting the user 130 to set a password for unmasking is displayed on the screen.

When the first password is set by the user 130 in response to the password setting request message, the vector extractor 120 performs a modulo operation with n as a divisor for the first password, After calculating the first operation value x, from the authentication matrix stored in the authentication matrix storage unit 117, the first column vector located at the x+1th column and the first row vector located at the x+1th row extract

Here, the modulo operation refers to an operation of calculating a remainder by performing division by dividing a dividend by a divisor.

When the first column vector and the first row vector are extracted by the vector extractor 120, the operation matrix generator 121 multiplies the first column vector and the first row vector to generate an n×n operation matrix. do.

When the operation matrix is generated by the operation matrix generator 121, the dummy image generation processing unit 122 divides an image area having the same size as the first image object into n x n parts to generate n x n divided areas, Among the n x n divided regions, the first reference image is inserted into each of the divided regions located at a point corresponding to a point where a '1' component is located in the authentication matrix, and a '0' component in the authentication matrix is inserted. The dummy image is generated by inserting the second reference image into each divided area located at a point corresponding to the location.

Hereinafter, operations of the password setting request unit 119, the vector extractor 120, the calculation matrix generator 121, and the dummy image generation processor 122 will be described in detail, for example.

First, as in the above example, let n be '3', and it is assumed that the 'image object 1 210' is inserted at the first point of the electronic document by the image inserting unit 115, and thereafter, Assume that a masking processing command for 'image object 1 (210)' is applied to the electronic terminal device 110 by the user 130.

Then, the password setting request unit 119 may display a password setting request message requesting the user 130 to set a password for unmasking on the screen.

At this time, in response to the password setting request message, when '1230' is set as the first password by the user 130, the vector extractor 120 sets '3' as a divisor for '1230'. By performing the modulo operation, the first operation value may be calculated as '0'.

'로부터, '1'번째 열에 위치하는 제1 열벡터인 '

'과, '1'번째 행에 위치하는 제1 행벡터인 '

'을 추출할 수 있다.Then, the vector extractor 120 uses the authentication matrix stored in the authentication matrix storage unit 117 '

From ', the first column vector located in the '1' column '

' and ', the first row vector located in the '1'th row, '

' can be extracted.

'과 상기 제1 행벡터인 '

'을 행렬 곱하여 '3 x 3' 크기의 연산 행렬을 '

'과 같이 생성할 수 있다.Then, the operation matrix generator 121 generates the first column vector '

' and the first row vector '

' is matrix multiplied to obtain an operation matrix of size '3 x 3'.

' can be created.

Then, as shown in FIG. 4 , the dummy image generation processing unit 122 divides the image area 410 having the same size as the 'image object 1 210' into '3 x 3' pieces, so that '9' The divided regions 411 , 412 , 413 , 414 , 415 , 416 , 417 , 418 , and 419 may be created.

Thereafter, the dummy image generation processing unit 122 selects the component '1' in the operation matrix among the '9' divided regions 411, 412, 413, 414, 415, 416, 417, 418, and 419. 'Reference image 1 (310)' is inserted into each of the divided areas located at the point corresponding to the point, and 'reference image 1 (310)' is inserted into each of the divided areas located at the point corresponding to the point where the '0' component is located in the authentication matrix. By inserting the image 2 (320)', the dummy image can be created.

'에서, '1'의 성분이 위치하는 지점은 '1행 1열, 1행 2열, 3행 1열, 3행 2열'이고, '9'개의 분할 영역들(411, 412, 413, 414, 415, 416, 417, 418, 419) 중 '1행 1열, 1행 2열, 3행 1열, 3행 2열'에 대응되는 지점에 위치하는 분할 영역들은 '분할 영역(411), 분할 영역(412), 분할 영역(417), 분할 영역(418)'이므로, 더미 이미지 생성 처리부(122)는 '분할 영역(411), 분할 영역(412), 분할 영역(417), 분할 영역(418)' 각각에 '참조 이미지 1(310)'을 삽입할 수 있다.In this regard, the operation matrix '

', the point at which the component of '1' is located is '1st row, 1st column, 1st row, 2nd column, 3rd row, 1st column, 3rd row, 2nd column', and '9' partitioned areas 411, 412, 413, 414, 415, 416, 417, 418, 419), the partitioned areas located at the points corresponding to '1st row, 1st column, 1st row, 2nd column, 3rd row, 1st column, 3rd row, 2nd column' are called 'partitioned areas 411'. , split area 412, split area 417, and split area 418', the dummy image generation processing unit 122 'segmented area 411, split area 412, split area 417, and split area (418)', 'reference image 1 (310)' may be inserted.

'에서, '0'의 성분이 위치하는 지점은 '1행 3열, 2행 1열, 2행 2열, 2행 3열, 3행 3열'이고, '9'개의 분할 영역들(411, 412, 413, 414, 415, 416, 417, 418, 419) 중 '1행 3열, 2행 1열, 2행 2열, 2행 3열, 3행 3열'에 대응되는 지점에 위치하는 분할 영역들은 '분할 영역(413), 분할 영역(414), 분할 영역(415), 분할 영역(416), 분할 영역(419)'이므로, 더미 이미지 생성 처리부(122)는 '분할 영역(413), 분할 영역(414), 분할 영역(415), 분할 영역(416), 분할 영역(419)' 각각에 '참조 이미지 2(320)'를 삽입할 수 있다.In addition, the operation matrix '

', the point at which the component of '0' is located is '1st row, 3rd column, 2nd row, 1st column, 2nd row, 2nd column, 2nd row, 3rd column, 3rd row, 3rd column', and '9' partitioned areas 411 , 412, 413, 414, 415, 416, 417, 418, 419) at the point corresponding to '1st row, 3rd column, 2nd row, 1st column, 2nd row, 2nd column, 2nd row, 3rd column, 3rd row, 3rd column' Since the divided regions are 'division area 413, segmentation area 414, segmentation area 415, segmentation area 416, and segmentation area 419', the dummy image generation processing unit 122 'segmentation area 413 ), the divided area 414, the divided area 415, the divided area 416, and the divided area 419', 'reference image 2 320' may be inserted.

In this way, the dummy image generation processing unit 122 may generate a dummy image having the same size as the 'image object 1 210' as shown in the figure 510 of FIG. 5 .

In this way, when the dummy image is generated by the dummy image generator 116, the masking processor 117 on the upper layer of the first image object inserted at the first point of the electronic document, The first image object is masked by overlapping and displaying the dummy image.

For example, as in the foregoing example, when it is assumed that the dummy image 510 is generated by the dummy image generation processor 122, the masking processor 117 processes the 'image object 1 inserted at the first point of the electronic document. By overlapping and displaying the dummy image 510 on the upper layer of '(210)', 'Image object 1 (210)' can be masked.

At this time, according to an embodiment of the present invention, the electronic terminal device 110 includes a password input request unit 123, a vector re-extraction unit 124, an operation matrix regeneration unit 125, a dummy matrix generation unit 126 and A masking release unit 127 may be further included.

After the first image object is masked by the masking processing unit 117, the password input request unit 123 receives a command to unmask the first image object by the user 130, the user ( 130), a password input request message requesting input of a password for unmasking is displayed on the screen.

When the first password is input by the user 130 in response to the password input request message, the vector re-extraction unit 124 performs a modulo operation with n as a divisor for the first password, After calculating the first operation value x, from the authentication matrix stored in the authentication matrix storage unit 117, the first column vector located at the x+1th column and the first column vector located at the x+1th row Re-extract the first row vector.

When the first column vector and the first row vector are re-extracted by the vector re-extracting unit 124, the operation matrix regenerating unit 125 multiplies the first column vector and the first row vector by a matrix to perform the operation of size n x n. Recreate the matrix.

When the operation matrix is regenerated by the operation matrix generator 125, the dummy matrix generator 126 divides the dummy image into n×n pieces to generate n×n dummy partitioned areas, and then divides the dummy image into n×n dummy partitioned areas. , by assigning a component of '1' to each of the dummy partitioned areas into which the first reference image is inserted, and by allocating a component of '0' to each of the dummy partitioned areas into which the second reference image is inserted; A dummy matrix of size n × n composed of '1' and '0' elements is created.

When the dummy matrix is generated by the dummy matrix generator 126, the unmasking unit 127 compares the dummy matrix with the operation matrix, and if it is confirmed that the dummy matrix matches the operation matrix, the first The masking applied to the first image object is released by removing the dummy image overlapping and displayed on the upper layer of the first image object.

Hereinafter, operations of the password input request unit 123, the vector re-extraction unit 124, the calculation matrix generator 125, the dummy matrix generator 126, and the masking unit 127 will be described in detail with examples. I'm going to do it.

First, as in the above example, it is assumed that n is '3' and 'Image object 1 (210)' is masked by the masking processing unit 117, and thereafter, the user ( 130), it is assumed that an unmasking command for 'image object 1 (210)' is applied.

Then, the password input request unit 123 may display a password input request message requesting the user 130 to input a password for unmasking on the screen.

'로부터, '1'번째 열에 위치하는 상기 제1 열벡터인 '

'과, '1'번째 행에 위치하는 상기 제1 행벡터인 '

'을 재추출할 수 있다.At this time, in response to the password input request message, when it is assumed that '1230', which is the first password, is input by the user 130, the vector re-extraction unit 124 divides '1230' by '3'. After calculating the first operation value '0' by performing a modulo operation to be, the authentication matrix '0' stored in the authentication matrix storage unit 117

From ', the first column vector located in the '1'th column, '

', and 'the first row vector located in the '1'th row, '

' can be re-extracted.

'과 상기 제1 행벡터인 '

'을 행렬 곱하여, '3 x 3' 크기의 상기 연산 행렬인 '

'을 재생성할 수 있다.Then, the operation matrix regeneration unit 125 generates the first column vector '

' and the first row vector '

' by matrix multiplication, the operation matrix of size '3 x 3''

' can be regenerated.

Then, as shown in FIG. 514, 515, 516, 517, 518, and 519) are generated, and 'reference image 1 ( 310)' is inserted into the '1' component, and by assigning a '0' component to each of the dummy partitioned areas into which the 'reference image 2 320' is inserted, ' A '3 x 3' dummy matrix composed of elements of '1' and '0' can be created.

In relation to this, among the '9' dummy partitioned areas 511, 512, 513, 514, 515, 516, 517, 518, and 519, dummy partitioned areas into which 'reference image 1 310' is inserted are 'dummy partitioned areas'. Region 511, dummy partition region 512, dummy partition region 517, and dummy partition region 518', so the dummy matrix generator 126 determines 'dummy partition region 511 and dummy partition region 512'. , the dummy partitioned area 517 and the dummy partitioned area 518' can be assigned a component of '1'.

In addition, among the '9' dummy partitioned areas 511, 512, 513, 514, 515, 516, 517, 518, and 519, dummy partitioned areas into which 'reference image 2 320' is inserted are 'dummy partitioned areas'. 513, the dummy partitioned area 514, the dummy partitioned area 515, the dummy partitioned area 516, and the dummy partitioned area 519' A component of '0' may be assigned to each of the dummy partition area 514, dummy partition area 515, dummy partition area 516, and dummy partition area 519'.

'과 같이 생성할 수 있다.In this way, the dummy matrix generator 126 creates a '3 x 3' dummy matrix composed of '1' and '0' elements.

' can be created.

'을 상기 연산 행렬인 '

'과 비교하여, 상기 더미 행렬이 상기 연산 행렬과 일치하는 것으로 확인한 후, '이미지 개체 1(210)'의 상위 레이어 상에 겹쳐서 표시되고 있는 더미 이미지(510)를 제거함으로써, '이미지 개체 1(210)'에 적용되어 있는 마스킹을 해제할 수 있다.Then, the demasking unit 127 is the dummy matrix '

' as the operation matrix '

', and after confirming that the dummy matrix matches the operation matrix, by removing the dummy image 510 overlapping and displayed on the upper layer of the 'image object 1 210', the 'image object 1 ( 210)' can be canceled.

Also, according to an embodiment of the present invention, the electronic terminal device 110 may further include a thumbnail display unit 128 .

After the first image object has been masked by the masking processor 117, the thumbnail display unit 128 displays a hover over the dummy image when the pointer of the input device connected to the electronic terminal device 110 is hovered over by the user 130. When hovered, a thumbnail image in which the resolution of the first image object is lowered at a preset ratio is generated, and the thumbnail image is displayed at a point adjacent to the point where the pointer hovers.

For example, as in the above example, it is assumed that 'image object 1 210' is masked by the masking processing unit 117, and then, as shown in FIG. 7, by the user 130, the electronic terminal Assume that the pointer 520 of the input device connected to the device 110 hovers over the dummy image 510 .

At this time, when the preset ratio is '20%', the thumbnail display unit 128 generates a thumbnail image 530 with the resolution of 'Image Object 1 210' lowered to '20%', and the pointer 520 A thumbnail image 530 may be displayed at a point adjacent to the hovered point.

In this regard, when the resolution of 'Image Object 1 210' is '360 dpi', the thumbnail display unit 128 sets the resolution of 'Image Object 1 210' to '72 dpi, which is '20%' of '360 dpi'. An image lowered to ' may be generated as a thumbnail image 530 .

8 is a flowchart illustrating an operating method of an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document according to an embodiment of the present invention.

In step S810, a regular expression storage unit in which a plurality of different regular expressions preset to correspond to the display format of personal information are stored is maintained.

In step S820, when an image insertion command instructing to insert a first image object at a first point of the electronic document is applied by the user, the text for the first image object is determined based on a preset text recognition model. Recognition is performed to extract text included in the first image object.

In step S830, when the text included in the first image object is extracted, a character string having a format corresponding to the plurality of regular expressions stored in the regular expression storage unit exists among the extracted text. check whether or not

In step S840, if it is confirmed that at least one first string exists as a string having a notation format corresponding to the plurality of regular expressions among the extracted text, the first image object for the user A query message inquiring whether to insert the first image object into the electronic document despite personal information being included is generated and displayed on the screen.

In step S850, when a command to insert a final image instructing to insert the first image object into the electronic document is applied by the user in response to the query message, the first image object is inserted into the electronic document at the first point. Insert the first image object.

At this time, according to an embodiment of the present invention, the operating method of the electronic terminal device is, after the first image object is inserted at the first point of the electronic document, by the user, for the first image object If a masking processing command is applied, generating a dummy image having the same size as the first image object, and if the dummy image is generated, an upper layer of the first image object inserted at the first point of the electronic document The method may further include masking the first image object by overlapping and displaying the dummy image on the image.

At this time, according to one embodiment of the present invention, in the step of generating the dummy image, an authentication matrix having a size of n (n is a natural number equal to or greater than 2) x n, composed of '1' and '0' components, is stored. maintaining an authentication matrix storage unit, a reference image storage unit in which a first reference image previously designated as corresponding to a component of '1' and a second reference image designated in advance as corresponding to a component of '0' are stored; and maintaining, if a masking processing command for the first image object is applied by the user after the first image object is inserted at the first point of the electronic document, releasing the masking for the user. Displaying a password setting request message requesting to set a password for the screen on the screen, in response to the password setting request message, when a first password is set by the user, n is a divisor for the first password After calculating a first calculation value x by performing a modulo operation, a first column vector located at an x+1th column and a first column vector located at an x+1th row from the authentication matrix stored in the authentication matrix storage unit extracting a first row vector located therein, generating an n×n operation matrix by matrix-multiplying the first column vector and the first row vector when the first column vector and the first row vector are extracted, and the operation matrix When is generated, after generating n x n divided areas by dividing the image area having the same size as the first image object into n x n pieces, the component '1' in the operation matrix is located among the n x n split areas. The first reference image is inserted into each divided region located at a point corresponding to a point, and the second reference image is inserted into each divided region located at a point corresponding to a point where an element of '0' is located in the operation matrix. A step of generating the dummy image by inserting .

At this time, according to an embodiment of the present invention, the operating method of the electronic terminal device, if a command to unmask the first image object is applied by the user after the first image object is masked, the Displaying a password input request message requesting the user to input a password for unmasking on the screen, in response to the password input request message, when the first password is input by the user, the After calculating the first operation value x by performing a modulo operation with n as a divisor for the first password, the authentication matrix located in the x+1th column from the authentication matrix storage unit is calculated. re-sampling a first column vector and the first row vector located in an x+1th row; when the first column vector and the first row vector are re-sampled, the first column vector and the first row vector are Regenerating the operation matrix having a size of n×n by performing matrix multiplication; and when the operation matrix is regenerated, dividing the dummy image into n×n pieces to generate n×n dummy partitioned areas, and then among the n×n dummy partitioned areas, the first By allocating a component of '1' to each of the dummy partitioned areas into which the first reference image is inserted and a component of '0' to each of the dummy partitioned areas into which the second reference image is inserted, '1' and Generating an n x n dummy matrix composed of '0' elements, and when the dummy matrix is generated, comparing the dummy matrix with the operation matrix, and when it is confirmed that the dummy matrix matches the operation matrix, The method may further include releasing masking applied to the first image object by removing the dummy image overlapping and displayed on a higher layer of the first image object.

Further, according to an embodiment of the present invention, the operating method of the electronic terminal device may include, after the first image object is masked, a pointer of an input device connected to the electronic terminal device is displayed on the dummy image by the user. The method may further include generating a thumbnail image in which the resolution of the first image object is lowered at a predetermined ratio when hovering over the pointer, and displaying the thumbnail image at a point adjacent to the point at which the pointer hovers.

In the above, the operating method of the electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document according to an embodiment of the present invention has been described with reference to FIG. 8 . Here, the operating method of the electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document according to an embodiment of the present invention is the electronic terminal device 110 described with reference to FIGS. 1 to 7 Since it may correspond to a configuration for an operation, a detailed description thereof will be omitted.

An operating method of an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document according to an embodiment of the present invention may be implemented as a computer program stored in a storage medium for execution through combination with a computer. can

In addition, the operating method of an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document according to an embodiment of the present invention is implemented in the form of program commands that can be executed through various computer means, It can be recorded on a readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler.

As described above, the present invention has been described by specific details such as specific components and limited embodiments and drawings, but these are provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , Those skilled in the art in the field to which the present invention belongs can make various modifications and variations from these descriptions.

Therefore, the spirit of the present invention should not be limited to the described embodiments, and it will be said that not only the claims to be described later, but also all modifications equivalent or equivalent to these claims belong to the scope of the present invention. .

110: Electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document
111: regular expression storage unit 112: text extraction unit
113: string confirmation unit 114: query message display unit
115: image inserting unit 116: dummy image generating unit
117: authentication matrix storage unit 118: reference image storage unit
119: password setting request unit 120: vector extraction unit
121: calculation matrix generator 122: dummy image generation processor
123: password input request unit 124: vector re-extraction unit
125: operation matrix regeneration unit 126: dummy matrix generation unit
127: unmasking unit 128: thumbnail display unit
130: user

Claims (12)

An electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document,
a regular expression storage unit in which a plurality of different regular expressions preset to correspond to the display format of personal information are stored;
When an image insertion command instructing to insert a first image object at a first point of the electronic document is applied by the user, text recognition is performed on the first image object based on a preset text recognition model, a text extraction unit extracting text included in the first image object;
When the text included in the first image object is extracted, checking whether a string having a format corresponding to the plurality of regular expressions stored in the regular expression storage unit exists among the extracted text string confirmation unit;
Among the extracted texts, if it is confirmed that at least one first string exists as a string having a format corresponding to the plurality of regular expressions, personal information is included in the first image object for the user a query message display unit generating and displaying a query message on a screen inquiring whether to insert the first image object into the electronic document despite the presence of the electronic document; and
In response to the query message, when a final image insertion command instructing to insert the first image object into the electronic document is applied by the user, the first image object is inserted at the first point of the electronic document. image insertion section
Electronic terminal device comprising a. According to claim 1,
After the first image object is inserted at the first point of the electronic document, if a masking processing command for the first image object is applied by the user, the same size as the first image object a dummy image generating unit generating a dummy image; and
When the dummy image is generated, masking the first image object by overlapping and displaying the dummy image on an upper layer of the first image object inserted at the first point of the electronic document. masking processing unit
Electronic terminal device further comprising a. According to claim 2,
The dummy image generating unit
an authentication matrix storage unit for storing an authentication matrix having a size of n (where n is a natural number greater than or equal to 2) xn composed of '1' and '0'components;
a reference image storage unit in which a first reference image pre-specified as corresponding to a '1' component and a pre-specified second reference image as corresponding to a '0' component are stored;
After the first image object is inserted at the first point of the electronic document, when a masking command for the first image object is applied by the user, a password for unmasking is set for the user. Password setting request unit for displaying a password setting request message requesting that on the screen;
In response to the password setting request message, when a first password is set by the user, a first calculation value x is calculated by performing a modulo operation with n as a divisor for the first password, and then a vector extractor extracting a first column vector positioned at an x+1-th column and a first row vector positioned at an x+1-th row from the authentication matrix stored in the authentication matrix storage unit;
an operation matrix generating unit generating an operation matrix having an nxn size by matrix-multiplying the first column vector and the first row vector when the first column vector and the first row vector are extracted; and
When the operation matrix is generated, nxn divided areas are generated by dividing the image area having the same size as the first image object into nxn pieces, and then, among the nxn divided areas, the component of '1' in the operation matrix The first reference image is inserted into each of the divided areas located at a point corresponding to the location of the first reference image, and the first reference image is inserted into each of the divided areas located at a point corresponding to the location of the '0' component in the operation matrix. 2 a dummy image generating processor generating the dummy image by inserting a reference image;
Electronic terminal device comprising a. According to claim 3,
After the first image object is masked by the masking processing unit, if a command to unmask the first image object is applied by the user, the user is prompted to input a password for unmasking. Password input requesting unit for displaying a requested password input request message on the screen;
In response to the password input request message, when the first password is input by the user, a modulo operation with n as a divisor is performed on the first password to calculate the first operation value x. a vector re-extraction unit configured to re-extract the first column vector located at an x+1-th column and the first row vector located at an x+1-th row from the authentication matrix stored in the authentication matrix storage unit;
an operation matrix regeneration unit regenerating the operation matrix having a size of nxn by multiplying the first column vector and the first row vector by a matrix when the first column vector and the first row vector are re-extracted;
When the operation matrix is regenerated, nxn dummy partitioned regions are generated by dividing the dummy image into nxn pieces, and then, among the nxn dummy partitioned regions, for each dummy partitioned region into which the first reference image is inserted. An nxn dummy matrix composed of '1' and '0' components by assigning a '1' component and assigning a '0' component to each of the dummy partition regions into which the second reference image is inserted. a dummy matrix generating unit that generates ; and
When the dummy matrix is generated, the dummy matrix is compared with the operation matrix, and if it is determined that the dummy matrix matches the operation matrix, the dummy image overlapping and displayed on the upper layer of the first image object is displayed. A masking release unit for canceling the masking applied to the first image object by removing the masking
Electronic terminal device further comprising a. According to claim 2,
After the first image object is masked by the masking processing unit, when the pointer of the input device connected to the electronic terminal device is hovered over the dummy image by the user, the first image object A thumbnail display unit that creates a thumbnail image whose resolution is lowered to a preset ratio and displays the thumbnail image at a point adjacent to the point where the pointer hovers.
Electronic terminal device further comprising a. A method of operating an electronic terminal device capable of identifying personal information included in an image object inserted into an electronic document, the method comprising:
maintaining a regular expression storage unit in which a plurality of different regular expressions preset to correspond to the display format of personal information are stored;
When an image insertion command instructing to insert a first image object at a first point of the electronic document is applied by the user, text recognition is performed on the first image object based on a preset text recognition model, extracting text included in the first image object;
When the text included in the first image object is extracted, checking whether a string having a format corresponding to the plurality of regular expressions stored in the regular expression storage unit exists among the extracted text step;
Among the extracted texts, if it is confirmed that at least one first string exists as a string having a format corresponding to the plurality of regular expressions, personal information is included in the first image object for the user generating an inquiry message inquiring whether to insert the first image object into the electronic document despite the fact that the first image object is inserted, and displaying the message on a screen; and
In response to the query message, when a final image insertion command instructing to insert the first image object into the electronic document is applied by the user, the first image object is inserted at the first point of the electronic document. step to insert
A method of operating an electronic terminal device comprising a. According to claim 6,
After the first image object is inserted at the first point of the electronic document, if a masking processing command for the first image object is applied by the user, the same size as the first image object generating a dummy image; and
When the dummy image is generated, masking the first image object by overlapping and displaying the dummy image on an upper layer of the first image object inserted at the first point of the electronic document. step
Method of operating an electronic terminal device further comprising a. According to claim 7,
The step of generating the dummy image is
maintaining an authentication matrix storage unit in which an authentication matrix having a size of n (n is a natural number greater than or equal to 2) xn, composed of '1' and '0' components, is stored;
maintaining a reference image storage unit in which a first reference image previously specified as corresponding to a component of '1' and a second reference image specified in advance as corresponding to a component of '0' are stored;
After the first image object is inserted at the first point of the electronic document, when a masking command for the first image object is applied by the user, a password for unmasking is set for the user. Displaying a password setting request message requesting that on the screen;
In response to the password setting request message, when a first password is set by the user, a first calculation value x is calculated by performing a modulo operation with n as a divisor for the first password, and then extracting a first column vector positioned at an x+1th column and a first row vector positioned at an x+1th row from the authentication matrix stored in the authentication matrix storage unit;
generating an nxn operation matrix by matrix-multiplying the first column vector and the first row vector when the first column vector and the first row vector are extracted; and
When the operation matrix is generated, nxn divided areas are generated by dividing the image area having the same size as the first image object into nxn pieces, and then, among the nxn divided areas, the component of '1' in the operation matrix The first reference image is inserted into each of the divided areas located at a point corresponding to the location of the first reference image, and the first reference image is inserted into each of the divided areas located at a point corresponding to the location of the '0' component in the operation matrix. 2 Generating the dummy image by inserting a reference image
A method of operating an electronic terminal device comprising a. According to claim 8,
After the first image object is masked, if a command to unmask the first image object is applied by the user, a password input request message requesting the user to input a password for unmasking displaying on the screen;
In response to the password input request message, when the first password is input by the user, a modulo operation with n as a divisor is performed on the first password to calculate the first operation value x. re-extracting the first column vector positioned at the x+1th column and the first row vector positioned at the x+1th row from the authentication matrix stored in the authentication matrix storage unit;
regenerating the operation matrix having an nxn size by matrix-multiplying the first column vector and the first row vector when the first column vector and the first row vector are re-extracted;
When the operation matrix is regenerated, nxn dummy partitioned regions are generated by dividing the dummy image into nxn pieces, and then, among the nxn dummy partitioned regions, for each dummy partitioned region into which the first reference image is inserted. An nxn dummy matrix composed of '1' and '0' components by assigning a '1' component and assigning a '0' component to each of the dummy partition regions into which the second reference image is inserted. generating; and
When the dummy matrix is generated, the dummy matrix is compared with the operation matrix, and if it is determined that the dummy matrix matches the operation matrix, the dummy image overlapping and displayed on the upper layer of the first image object is displayed. releasing the masking applied to the first image object by removing it;
Method of operating an electronic terminal device further comprising a. According to claim 8,
After the first image object is masked, when a pointer of an input device connected to the electronic terminal device is hovered over the dummy image by the user, the resolution of the first image object is reduced to a preset ratio. Generating a lowered thumbnail image and displaying the thumbnail image at a point adjacent to a point at which the pointer hovers
Method of operating an electronic terminal device further comprising a. A computer-readable recording medium recording a computer program for executing the method of any one of claims 6 to 10 through a combination with a computer. A computer program stored in a storage medium for executing the method of any one of claims 6 to 10 through a combination with a computer.

Images