JP2012049860A - Image processor, image processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processor for securely masking a necessary place and improving information confidentiality.SOLUTION: The image processor includes: a data acquiring portion 202 acquiring display data before it is transmitted to a display device to be displayed; a data determination portion 203 determining whether the acquired display data is image data or not; a character recognition processing portion 204 recognizing characters in a character image included in the image data when the display data is the image data; a keyword retrieval portion 205 retrieving data matched with a keyword in the acquired text data or result data where the characters are recognized by using a masking dictionary which correspondingly stores the keyword and a place to be masked, and specifying the place to be masked; a masking processing portion 207 masking the specified place; and a data output portion 208 outputting the text data or the image data generated by the masking processing to the display device as the display data.

Description

  The present invention improves information confidentiality by acquiring display data before displaying on a display device, finding a portion that needs to be masked, performing a masking process such as painting the portion, and outputting the result to the display device. The present invention relates to an image processing apparatus, a method thereof, and a computer-readable program for realizing the method.

  Various information such as character strings of screen UI (User Interface), text data such as editors and word processors, document image data read by image reading devices such as scanners and CCD (Charge Coupled Device) cameras, etc. are displayed on a display device such as a display. An image processing apparatus is used for a user to browse and edit based on the displayed information.

  When distributing image data input from an image reader to the outside, if the image data contains information that you do not want to be seen by others, the information is masked and kept secret. Yes. For example, an object with a masking function is placed electronically on the image data, and the image data under the masking object is recorded in the data being edited and recorded and output by an output device such as a printer. In this case, a configuration is known in which an image processing program is installed so that image data under a masking object cannot be confirmed (see Patent Document 1).

  In this Patent Document 1, when an image processing program is executed, image data is read from a data recording medium and rendered on a memory, while a graphic object is read from an input device and output on a display. When drawing on the image data on the memory in accordance with the mask pattern function and outputting it to the printer, the drawing is performed on the image data on the memory according to the characteristics of the graphic object. As a result, information hidden by masking on the display can be confirmed during editing, and information output to a printer for external distribution can be prevented from being confirmed.

  In addition, an image processing unit that holds each item of personal information and the coordinate position of personal information included in the image data in association with each other, and performs image processing such as masking processing on the image data according to the selected item; There has been proposed an image processing apparatus including an image forming unit that prints out image data subjected to image processing (see Patent Document 2). In this way, when the coordinate position of each personal information is held and copied, by masking the personal information that is not desired to be displayed, only desired information can be selectively output.

  Also, a PDL (Page Description Language) data image is previewed on a display device, a user-selected area of the preview displayed image is set as a masking area, and a date and time input by the user is set. Is set as the expiration date for masking, the image in the set masking area is cut out as the masking target image, the cut out masking target image is encrypted to create an encrypted image, and this is used as the expiration date for expressing the expiration date There has been proposed an apparatus and method for generating a masking image synthesized with an image, printing an image in which the masking image is inserted into a masking area in an image of PDL data, and providing a masking document (see Patent Document 3). . As a result, it is possible to facilitate the fusion of the electronic document that has been subjected to the masking process in a state where the expiration date is set in the partial area and the printed matter.

  A configuration has been proposed in which information on a screen is handled as an image and a portion that needs to be blanked or mosaiced using an optical character recognition technique is determined (see Non-Patent Document 1). Unlike traditional methods of concealment, the information can be filtered before it is displayed on the screen without modifying the software or altering the data, and the parts to be concealed can be changed by the user Have been able to. As a result, it is possible to save the trouble of preparing data in which display items are corrected for each provider.

  In the invention described in the above-mentioned Patent Document 1, it is possible to mask information that is not desired to be seen, but at the stage before displaying it on a display device such as a display, it is masked due to a setting omission of a portion to be masked. There is a problem that confidential information is leaked.

  Although the above-mentioned Patent Document 2 can mask information that is not desired to be viewed, there is a problem that it takes much time and effort because the masking designation is performed manually.

  Similarly, the above-mentioned Patent Document 3 can mask information that is not desired to be seen, but since coordinate data is determined in advance for masking designation, it cannot respond when non-standard data comes. There's a problem.

  In the above non-patent document 1, since information displayed on a display is handled as an image, it is necessary to perform character recognition even for text data, and since recognition accuracy is limited, it may not be correctly masked due to misrecognition. There is sex.

  The present invention has been made in view of the above problems, and displays various information such as a character string of a screen UI, text data of an editor, a word processor, etc., document image data read by a scanner, a CCD camera, etc., on a display device such as a display. Before display, for example, the screen is captured at regular intervals, the character string or text data is treated as characters, only the image data is recognized, and keywords that require masking from the recognition result character data, character string, or text data. A configuration is adopted in which a masking dictionary is found and necessary portions are painted on the screen.

  In this way, display data displayed on the screen of the display device is acquired before being displayed, character strings and text data on the screen UI are used as they are, only image data is recognized, and a masking dictionary is referred to. Masking processing is performed at the required location and output, preventing information leakage due to forgetting to mask, automatic masking can be specified, and text data does not require character recognition, reducing false recognition Can be masked more reliably.

  In the present invention, it is possible to provide an image processing apparatus, an image processing method, and a computer-readable program for realizing the method for realizing these.

  An image processing apparatus according to the present invention is a device that processes and displays display data. A data acquisition unit that acquires display data before being transmitted to the display device and displayed, and whether the acquired display data is image data. A data determination unit that determines whether the data is text data, a character recognition processing unit that performs character recognition of a character image included in the image data when the display data is image data, a keyword and a portion to be masked Using the masking dictionary stored in association with each other, the text data or the result data recognized by the character recognition processing unit is searched for a match with the keyword in the obtained text data or the result data recognized by the character recognition processing unit. A keyword search part that specifies the location to be masked in the text and the specified location of the acquired text data or image data To include a masking processing unit for masking process, and a data output section for outputting to the display device a text data or image data generated by the masking processing as the display data.

  The data acquisition unit can set a flag according to the display data to be acquired, and the data determination unit can determine whether the data is image data or text data according to the flag set for the display data. The data acquisition unit captures a screen or intercepts text data or a UI character string that outputs a drawing command, and acquires display data. At this time, the display data obtained by capturing the screen is stored as image data, text data, UI character strings, and the like are stored as text data, and flags having different values are set for each.

  Further, the data acquisition unit acquires display data at regular intervals, acquires display data in response to a user operation, or acquires display data in response to screen switching. By acquiring display data according to such conditions, even when display data including confidential information is transmitted to the display device on the way, display data including confidential information is transmitted to the display device by a user operation. Even when the display data including the confidential information is transmitted to the display device by switching the screen, the confidential information is surely masked and displayed on the display device so that it cannot be seen by others. Can be made.

  The character recognition processing unit extracts a character region, compares it with each character image of a character pattern dictionary created in advance, identifies the character, and converts it into text data as result data.

  The masking dictionary further includes an application name of an application used to display the display data and a character type of a character included in a portion to be masked. Therefore, it is possible to perform masking processing by determining the application and character type to be used.

The masking dictionary further includes character image data corresponding to the keyword and character type,
The keyword search unit can perform a matching process between the character image included in the image data and the character image included in the masking dictionary to find a portion to be masked.

  The masking processing unit refers to the security level set by the user, and depending on the security level, the part to be masked is displayed as one of low contrast, blurring, adding grid lines, filling, or mosaic. Masking processing can be performed. The data output unit can output the text data or the image data generated by the masking process to the printing apparatus instead of the display apparatus or together with the display apparatus, and can be disabled by user setting.

  The image processing method of the present invention includes processing executed by each unit included in the image processing apparatus as processing steps, and the program can be configured to cause a computer to execute the processing steps.

1 is a diagram illustrating a hardware configuration of an image processing apparatus according to an embodiment. The functional block diagram of an image processing apparatus. 3 is a flowchart illustrating a first embodiment of image processing performed by the image processing apparatus. The figure which showed 1st Embodiment of the masking dictionary. 6 is a flowchart illustrating a second embodiment of image processing performed by the image processing apparatus. The figure which showed 2nd Embodiment of the masking dictionary. The figure which showed one example of display data. The figure which illustrated the place which is performing the matching process. The figure which showed another example of display data. The figure which performed the masking process to the display data shown in FIG. The figure which illustrated the character string which performed masking processing according to the security level.

  FIG. 1 is a diagram illustrating a hardware configuration of the image processing apparatus according to the present embodiment. The image processing apparatus 100 includes a scanner unit 101 that reads a document and the like, an imaging unit 102 that captures and acquires image data, a CPU 103 that controls the entire apparatus, read image data, image data acquired by imaging, and the like A display data memory unit 104 for storing the image data, and a CD-ROM, a DVD, a DVD-ROM, a DVD-ROM for storing a program executed by the CPU 103, storing the image data, recording image data acquired from another device, and the like Communication that controls communication between the external storage unit 105 such as the memory card 106 and the HDD 107, the image processing unit 108 that performs masking processing and other image processing, and the network 110 such as the Internet, and controls communication with the network 110. The control unit 109 and the image data subjected to masking processing and other image processing It is configured to include a display unit 111 for displaying the data. These units are connected to each other by a bus 112 for transmitting data, and can exchange data with each other.

  The scanner unit 101 irradiates a document to be read with light, a CCD that reads light reflected or transmitted through the document and converts it into an electrical signal, and converts an electrical signal that is analog data into digital data. And an A / D converter.

  For example, the image pickup means 102 can be a digital camera, and its configuration includes an image pickup element such as a condensing lens, a diaphragm for determining the amount of light, an optical sensor for detecting light, and an image pickup element only for a determined time. It is assumed that a shutter for shining light and a viewfinder for confirming an imaging target are provided. A CCD or CMOS is used as the image sensor. The imaging unit 102 further includes an A / D converter that performs A / D conversion on analog data output from the imaging device, and further includes interpolation calculation, color space conversion, gamma correction, aberration correction, noise reduction, image compression, and the like. And an image engine that records on a recording medium as an image format that can be used by a PC or the like, for example, an Exif (Exchangeable image file format) format or a RAW image. Here, the Exif format is an extended standard of JPEG (Joint Photographic Experts Group), which is one of methods for compressing digital data of still images handled by a computer or the like, and is a format of image metadata.

  The display data memory unit 104 stores display data such as text and UI data, and display data acquired by the scanner unit 101 and the imaging unit 102 described above.

  The image processing unit 108 performs processing for masking display data to be displayed on the display unit 111, and performs image processing such as color correction and conversion to a predetermined format.

  FIG. 2 is a functional block diagram of the image processing apparatus. The image processing apparatus has the hardware configuration shown in FIG. 1, but the CPU 103 executes a program stored in the external storage unit 105, and the image processing unit 108 performs image processing, whereby each unit shown in FIG. Can function as.

  This image processing apparatus is an apparatus that masks and outputs a portion of confidential information in order to prevent leakage of confidential information, and includes a UI providing unit 201, a data acquisition unit 202, a data determination unit 203, and character recognition processing. A unit 204, a keyword search unit 205, a masking dictionary storage unit 206, a masking processing unit 207, and a data output unit 208 are configured. Further, the image processing apparatus can include a data storage unit (not shown) for storing display data.

  The UI providing unit 201 provides UI data such as objects and text data including Windows (registered trademark) windows.

  The data acquisition unit 202 acquires display data that is transmitted to the display unit 111 that is a display device and that is not displayed on the display unit 111. This is because leakage of confidential information cannot be prevented by masking after being displayed. The display data is data to be displayed on the display unit 111, and is provided by the UI providing unit 201, image data read by the scanner unit 101, image data acquired from the imaging unit 102, text data for outputting a drawing command. UI data to be used.

  The data acquisition unit 202 captures a screen or intercepts text data or UI data to acquire display data. Therefore, the data acquired by capturing the screen is identified as image data, and the text data or UI is captured. Data is identified as text data. The data identified in this way can be set, for example, by flags to allow discrimination. The flag is expressed by 1 bit, and can be set by numerical values such as 1 for image data and 0 for text data.

  In addition, the data acquisition unit 202 acquires display data at regular intervals, acquires it in response to a user operation (for example, pressing a button), or responds to the occurrence of screen switching. It can be acquired, and masking is performed before the next screen is displayed, so that leakage of confidential information can be surely prevented.

  The data determination unit 203 determines whether the display data acquired by the data acquisition unit 202 is image data or text data. This determination can be made by reading the flag set in the display data and determining the value of the flag.

  The character recognition processing unit 204 receives display data determined as image data by the data determination unit 203, and performs character recognition of a character image representing a character included in the image data that is the display data. Any method known so far can be used as the character recognition method. For example, a character pattern of each character is prepared as a character pattern dictionary, and the character pattern is matched with the character pattern. Recognition can be performed.

  The masking dictionary storage unit 206 stores a masking dictionary that stores a keyword and a portion to be masked in association with each other. The keyword is a word composed of a character string, and includes name, address, telephone number, mobile phone number, date of birth, sex, company name, affiliation, etc., which are confidential information. Masking refers to covering a character or image with a cover, and specifically, covering a character example to make it invisible. The parts to be masked are the right side of the same row as the keyword, the lower side of the same column as the keyword, the right cell of the same row as the keyword, and the like. Therefore, when an address is set as a keyword and the right side of the same line is set as a portion to be masked, the portion to be masked is a keyword if “address A city B town C” is described. It means the part of “A city B town C” on the right side of the same address. In this way, confidential information is made invisible and leakage of the information is prevented.

  The keyword search unit 205 uses the masking dictionary to search the acquired text data or the result data recognized by the character recognition processing unit 204 for data that matches the keyword. And the location which should be masked in the text data or the result data by which character recognition was carried out is specified.

  Further, when the display data is image data, the keyword search unit 205 performs matching processing between the character image generated from the image data and the character image generated from the character image data included in the masking dictionary, and performs masking. Find where to go. For this reason, the masking dictionary can store character image data in association with keywords.

  The masking processing unit 207 masks the portion to be masked specified by the keyword search unit 205 by the set masking method. The user can set the security level, and depending on the security level, the area to be masked is made low contrast, blurred, added with a grid line, painted, or mosaiced. be able to. Note that the masking process is performed on all character strings, numeric strings, and the like that are specified as portions to be masked.

  The masking dictionary can further store an application name of an application used for displaying display data, a character type of a character string in a portion to be masked, and the like in association with a keyword. As a result, the masking processing unit 207 can determine the application to be used and perform masking when the character type is determined and matched.

  The data output unit 208 outputs display data, which is text data or image data generated by the masking processing by the masking processing unit 207, to the display unit 111 for display. The data output unit 208 can output to the printing apparatus in addition to the display unit 111, and can also print out the masked data. Also, depending on the setting such as the security level, it is possible to print out or disable printing.

  FIG. 3 is a flowchart illustrating a first embodiment of image processing performed by the image processing apparatus. The flow of image processing will be described with reference to this flowchart. The image processing starts from step 300. First, in step 310, display data is acquired.

  Here, an example of a method for acquiring display data will be described in detail. The acquisition condition can be acquired, for example, when a specific operation is performed every certain period or when the screen is switched. An example of the fixed period is capturing the screen at an interval of 10 to 100 milliseconds, for example. Examples of when a specific operation is performed include when a button is pressed or when an operation for browsing is performed. An example of when the screen is switched is when the display screen changes.

  When such a condition occurs, display data can be acquired by capturing a screen or capturing text data for issuing a drawing command, a UI character string, or the like. When the screen is captured, the data is stored as image data. In addition, when the text data or the like is intercepted and acquired, the text data, the UI character string, and the like are accumulated as the text data.

  As these specific methods, a known screen reader (for example, JAWS (registered trademark) for Windows (registered trademark)) can be used. This screen reader is used for information and input displayed on a screen or a window. Read aloud characters.

  Next, in step 320, it is determined whether the acquired screen data is image data or text data. This determination can be made from the set flag since the flag for acquiring text data or the flag for acquiring as image data is set in step 310.

  In step 330, if it is image data from the result determined in step 320, character recognition processing is performed, and text data that is result data of character recognition is obtained. As the character recognition process, any known technique can be used.

  For example, in the case of a document image, since the image data is composed of information of white and black, first, the distribution of black dots is analyzed, and this black cluster is classified into ruled lines, numbers, and the like. This analyzes trends such as area and shape, and classifies them based on their characteristics. After classification, it is collated with a character pattern dictionary created in advance and converted into text data by identifying characters and numbers. To explain the flow, the input document image is divided into an area to be treated as an image such as a photograph and a character area, the character image is compared with a pattern, and a large overlapping area is converted into characters or numbers to be converted. Determine and convert it as text data.

  In the case of color image data, it is not binary image data of white and black but multi-value image data. First, a photo area is extracted, and the background color is specified and deleted. Thereafter, the data is converted into black and white binary data, and the character portion is converted into text data. Similar to the above, this conversion can be performed by identifying characters and numbers by a method of matching with a pattern and converting the characters and numbers into the identified characters and numbers.

  In this way, the data is converted to text data. This data includes layout information, character color information, and the like, and can be reproduced as a word processor document.

  When converting to text data, remove any smudges or shading in the image data, and if the document is scanned at an angle, analyze the inclination of characters and ruled lines and correct the skew so that it is horizontal. Even if the vertical direction is scanned incorrectly, the direction can be determined and corrected in the correct direction. After these processes, the image area and the character area are divided into patterns, collated, and converted to text data. can do.

  From the result determined in step 320, in the case of text data in the screen data, or after being converted into text data in step 330, the process proceeds to step 340 to search the text data that matches the keyword corresponding to the confidential information. . Note that keywords corresponding to confidential information are stored in the masking dictionary storage unit 206.

  FIG. 4 shows an example of the masking dictionary stored in the masking dictionary storage unit 206. The masking dictionary is configured as a table, and includes a keyword, an application, a masking position that is a portion to be masked, and a character type as data. The keyword is a word used in association with information to be masked and concealed, and specifically includes characters such as telephone, tel, fax, name, name, and address in addition to those described above. The application is an application used for image data or text data to which masking is applied.

  The masking position indicates which position is to be masked with respect to the keyword. If “right of the same line”, it means that the text on the right side of the keyword on the same line as the keyword is masked. The character type is information indicating what character type the information to be masked and concealed is. A number or hyphen indicates that the text data is composed of a number and a hyphen.

  Referring again to FIG. 3, when a keyword is found in step 350, the vicinity of the location where the keyword is located is referred to using the above-described masking dictionary to find a location to be masked. Details of the searching process will be described later.

  Thereafter, in step 360, a masking process is performed on the identified portion to be masked. In step 370, the data generated by the masking process is output and displayed on the screen, and in step 380, the process ends. Incidentally, if there is no keyword matching in step 340, screen data including image data or text data is displayed in step 370 without performing masking processing, and this processing is terminated in step 380.

  FIG. 5 is a flowchart illustrating a second embodiment of image processing performed by the image processing apparatus. Starting from step 500, first, in step 510, display data is acquired. This display data can be acquired by the same method as described above.

  Next, in step 520, it is determined whether the acquired screen data is image data or text data. This can also be determined by the set flag as described above.

  If it is determined in step 520 that the data is text data, the process proceeds to step 530, and the text data is searched from the masking dictionary that matches the keyword corresponding to the confidential information. If there is a match with the keyword, the process proceeds to step 540, and if not, the process proceeds to step 580. In step 540, the masking dictionary stored in the masking dictionary storage unit 206 is referred to search for a portion to be masked. In step 570, the masking process is performed on the portion to be masked. In step 580, the masked data is output and displayed on the screen. In step 590, the process ends.

  If it is determined in step 520 that the data is image data, the process proceeds to step 550, where the character image included in the image data is matched with the character image in the masking dictionary to find a portion to be masked. Then, in step 560, it is determined whether or not there is a portion to be masked. If there is, the process proceeds to step 570, where the portion to be masked is masked. On the other hand, if not, the process proceeds to step 580, where it is output as it is and displayed on the screen.

  The matching process is a process in which a character image in the image data is compared with a character in the masking dictionary to find a portion to be masked. Therefore, as shown in the table of FIG. 6, the masking dictionary includes keywords (words) corresponding to confidential information, applications used for display at the display data acquisition source, and masking that is a portion to be masked. In addition to the position and character type, the image data of the character image is included.

  If a keyword is found and found, the part is marked, and the character string before and after the part where the keyword is found is referred to the masking position of the masking dictionary to finally identify the masking position. As shown in FIG. 7, the keywords “name” and “address” are found, and after that, “image Taro”, “Tokyo city B city C town 1-5-3” character string etc. which should be masked And masking the character string or the like.

  In document image data such as a form, it is possible to register a portion indicating important information in a masking dictionary for a format format such as a layout configuration, and mask the portion.

  The matching process can be performed by superimposing elements such as “a” and “o” shown in FIG. 8 on the matching data and determining whether the degree of matching is high by looking at the difference. In the embodiment shown in FIG. 8, even if the “2” of the element 2 is compared with the matching data “A”, the overlapping area is small, so the degree of matching is low, but the “A” of the element 1 has an overlapping area. In most cases, since the degree of coincidence is high, element 1 is identified as “A”. For example, a threshold value is set, and a letter or number that overlaps the area exceeding the threshold value is judged as a letter or number with a high degree of matching, and if there are multiple letters or numbers, the one with the highest degree of matching is converted. Can be identified as a power or number.

  FIG. 9 is a display example of data displayed on the screen, and includes a name, company name, affiliation, postal code, address, telephone number, and the like. These are important information for identifying an individual and are information that other people do not want to see. When these pieces of information are registered as keywords, by executing the masking process of the present invention, characters, numbers, etc. on the right side of these keywords are masked and displayed as a screen as shown in FIG. In FIG. 10, the masked portion is painted black and cannot be seen.

  The masking process can be changed as shown in FIG. 11 according to the security level set by the user. For example, normal display, difficult-to-view display, and invisible display can be set according to the security level. In the case of normal display, it can be displayed as it is or highlighted. In the case of difficult-to-view display, it is possible to make the display difficult to view such as low-contrast display, blurring, and grid lines. In the case of invisible display, it is possible to make a display incapable of visual recognition such as solid paint (filling) and mosaic processing.

  Also, not only on the screen display but also when outputting to a printer or the like, depending on the security level set by the user, a flag indicating whether printing is possible or not is set, and if the flag is not printing, printing is not performed. Can be.

  The present invention has been described with the above-described embodiments, but the present invention is not limited to the above-described embodiments, and those skilled in the art will conceive other embodiments, additions, changes, deletions, and the like. It can be changed within the range that can be performed, and any embodiment is included in the scope of the present invention as long as the operation and effect of the present invention are exhibited. Therefore, in addition to the image processing apparatus and the image processing method described above, the present invention can also provide a computer-readable program for executing the method and a recording medium on which the program is recorded.

DESCRIPTION OF SYMBOLS 100 ... Image processing apparatus, 101 ... Scanner part, 102 ... Imaging means, 103 ... CPU, 104 ... Display data memory part, 105 ... External storage part, 106 ... CR-ROM, DVD, memory card, 107 ... HDD, 108 ... Image processing unit 109 ... Communication control unit 110 ... Network 111 ... Display unit 112 ... Bus 201 ... UI providing unit 202 ... Data acquisition unit 203 ... Data determination unit 204 ... Character recognition processing unit 205 ... Keyword search unit, 206 ... masking dictionary storage unit, 207 ... masking processing unit, 208 ... data output unit

JP 2004-228709 A JP 2007-074295 A Japanese Patent Laid-Open No. 2007-074088

“Data processing is unnecessary: IBM announces technology to mask confidential information on display”, [online], July 10, 2009, Internet <URL: http://www.itmedia.co.jp/enterprise /articles/0907/10/news059.html>

Claims (17)

An image processing apparatus that processes and displays display data,
A data acquisition unit for acquiring the display data before being transmitted to the display device and displayed;
A data determination unit for determining whether the acquired display data is image data or text data;
A character recognition processing unit that performs character recognition of a character image included in the image data when the display data is image data;
Using a masking dictionary that stores a keyword and a portion to be masked in association with each other, search the acquired text data or result data recognized by the character recognition processing unit for a match with the keyword, A keyword search unit for specifying a portion to be masked in the text data or the character-recognized result data;
A masking processing unit that performs a masking process on the specified portion of the acquired text data or the image data;
An image processing apparatus comprising: a data output unit that outputs text data or image data generated by masking processing to the display apparatus as the display data.   The data acquisition unit sets a flag according to the display data to be acquired, and the data determination unit determines whether the data is the image data or the text data according to the flag set for the display data. The image processing apparatus according to claim 1, wherein:   The data acquisition unit acquires the display data at regular intervals, acquires the display data in response to a user operation, or acquires the display data in response to screen switching The image processing apparatus according to claim 1 or 2.   The character recognition processing unit extracts a character region, compares it with each character image in a character pattern dictionary created in advance, and identifies the character to convert it into text data as the result data. The image processing apparatus according to any one of?   The masking dictionary further includes an application name of an application used for displaying the display data and a character type of a character included in the portion to be masked, and the application to be used and the portion to be masked. The image processing apparatus according to claim 1, wherein the character type is determined and masking is performed. The masking dictionary further includes character image data corresponding to the keyword and the character type,
The image processing apparatus according to claim 5, wherein the keyword search unit performs a matching process between a character image included in the image data and a character image included in the masking dictionary to search for a portion to be masked.   The masking processing unit refers to the security level set by the user, and the portion to be masked is displayed as one of low contrast, blurring, addition of a grid line, painting, and mosaic according to the security level. The image processing apparatus according to claim 1, wherein the masking process is performed as described above. The image according to any one of claims 1 to 7, wherein the data output unit outputs text data or image data generated by masking processing to a printing apparatus instead of the display apparatus or together with the display apparatus. Processing equipment. An image processing method for processing and displaying display data, the method being executed by an image processing device,
Obtaining the display data before being transmitted to the display device and displayed;
Determining whether the acquired display data is image data or text data;
When the display data is image data, performing character recognition of a character image included in the image data;
Using a masking dictionary that stores a keyword and a portion to be masked in association with each other, search the acquired text data or the result data recognized in the character recognition step to search for a match with the keyword, Identifying a portion to be masked in the text data or the character-recognized result data;
Masking the specified portion of the acquired text data or image data; and
Outputting the text data or image data generated by the masking process to the display device as the display data.   In the obtaining step, a flag is set in accordance with the display data to be obtained, and in the determining step, whether the image data or the text data is in accordance with the flag set in the display data. The image processing method according to claim 9, wherein:   In the obtaining step, the display data is obtained at regular intervals, or the display data is obtained in response to a user operation, or the display data is obtained in response to a screen switching. The image processing method according to claim 9 or 10.   The step of recognizing the character includes a step of extracting a character region, comparing it with each character image of a character pattern dictionary created in advance, and converting the text data as the result data by identifying the character. The image processing method according to any one of claims 9 to 11.   The masking dictionary further includes an application name of an application used for displaying the display data and a character type of a character included in the portion to be masked, and is used in the masking step. The image processing method according to claim 9, wherein masking processing is performed by determining an application and the character type of the portion to be masked. The masking dictionary further includes character image data corresponding to the keyword and the character type,
The image processing according to claim 13, wherein the specifying step includes a step of performing matching processing between a character image included in the image data and a character image included in the masking dictionary and searching for a portion to be masked. Method.   In the step of masking, the security level set by the user is referred to, and the portion to be masked is displayed as one of low contrast, blurring, addition of a grid line, painting, and mosaic according to the security level. The image processing method according to claim 9, wherein the masking process is performed as described above. The image according to any one of claims 9 to 15, wherein in the outputting step, text data or image data generated by a masking process is output to a printing device instead of the display device or together with the display device. Processing method.   The computer-readable program for performing the image processing method of any one of Claims 9-16.