JP2012221367A - Display unit and display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To generate an image from a character string displayed on a manuscript and display the image by a simple operation.SOLUTION: A display unit comprises a screen that displays an image of a manuscript, and has a function to recognize a character in the manuscript displayed on the screen and a function to recognize a figure written on the screen by a touch pen. The display unit further comprises: an input/output management section that identifies a write area defined by a figure when the figure is written to the screen where the image of the manuscript is displayed, and acquires a character string displayed in the write area; an input image analysis section that analyzes the acquired character string, and identifies an image type of the image to be generated on the basis of the character string or displays a candidate for allowing a user to select the image type; an image generation section that generates an image of the identified or selected image type; and an image display section that displays the image of the manuscript displayed on the screen by overlapping the displayed image with the generated image.

Description

  The present invention relates to a display device and a display control program, and more particularly to a display device including a touch panel that can be input with a touch pen or the like, and a display control program that operates on the display device.

  In recent years, display devices equipped with a touch panel such as a tablet terminal have been used for conferences, etc., for example, using an electronic conference application that operates on the display device, to display a conference document on the screen of the display device, A memo or the like is added to or saved in the displayed manuscript.

  As a technique for adding a memo or the like to a manuscript, for example, Japanese Patent Application Laid-Open No. 2004-151867 discloses a reading unit that reads a manuscript image and obtains image data, and a method for displaying the image data on a display device based on the image data. Electronic document generation means for generating electronic document data; extraction means for extracting a write-once area including a part added by handwriting from the image data; and generation means for generating annotation data based on the write-once area Setting means for calculating a position for the display device to display the annotation data on the electronic document data based on the position of the additional recording area on the image data, and setting the position for the annotation data An image forming apparatus is disclosed.

JP 2008-181485 A

  By making it possible to add a note to a displayed document with a touch pen, characters can be added to the document in the same way as a document printed on a paper medium. It can only be pasted on sticky notes, etc., and it was insufficient as a postscript.

  For example, when an address is included in a manuscript or the like, the address can be confirmed on a map, when data is included in a manuscript or the like, the data can be confirmed in a graph, or a URL (Uniform Resource If the URL can be confirmed as code information when a (Locator) is included, it is very convenient for the user viewing the document.

  However, with the conventional method, it is difficult to add an image such as a map, a graph, or code information by handwriting. Even if an image such as a map or graph can be added by hand, the process of converting text information such as an address or data into an image such as a map or graph must be performed by the user himself. is there. In addition, when the user himself / herself adds an image by hand, an accurate map created based on the map data and an accurate graph created using a data processing application cannot be added.

  The present invention has been made in view of the above problems, and a main object of the present invention is to provide a display device and display control capable of generating and displaying an image from a character string displayed on a document with a simple operation. To provide a program.

  In order to achieve the above object, the present invention has a screen for displaying an image of a document, a function for recognizing characters in the document displayed on the screen, and a figure written on the screen with a touch pen. And when a graphic is written on the screen on which the image of the document is displayed, a writing area defined by the graphic is specified and displayed in the writing area. An input / output management unit that obtains a character string, and an analysis of the obtained character string to identify an image type of an image to be generated based on the character string, or a candidate for allowing the user to select the image type An input image analysis unit to be displayed, an image generation unit that generates an image of the specified or selected image type based on the acquired character string, and an image of the document displayed on the screen An image display unit for displaying overlapping the image, but with a.

  The present invention also has a screen for displaying an image of a document, a function for recognizing characters in the document displayed on the screen, and a function for recognizing a graphic written on the screen with a touch pen. A display control program that operates on a display device provided with the display device, when a graphic is written on the screen on which an image of the document is displayed, specifies a writing area defined by the graphic, and the writing Input / output management unit that acquires the character string displayed in the area, analyzes the acquired character string, specifies the image type of the image to be generated based on the character string, or selects the image type to the user An input image analysis unit that displays candidates for image generation, an image generation unit that generates an image of the image type specified or selected based on the acquired character string, and before being displayed on the screen The image of a document, an image display unit for displaying overlapping the generated the image, is intended to function as a.

  According to the display device and the display control program of the present invention, an image can be generated and displayed from a character string displayed on a manuscript with a simple operation.

  The reason is that when writing is performed so as to surround the character string described in the document, the character string in the writing area is acquired and analyzed, and the image type of the image generated based on the character string is specified, or This is because a candidate for allowing the user to select an image type is displayed, an image of the specified or selected image type is generated from the acquired character string, and is displayed so as to be superimposed on the image of the document.

  Thereby, it is possible to provide useful information to the user who browses the document by making full use of the characteristics of the usage pattern in which the document is displayed on the display device, and the convenience for the user can be greatly improved.

  In addition, by analyzing how to enclose character strings and character strings and learning based on history information, an image desired by the user can be provided immediately.

It is a figure which shows an example of the display apparatus which concerns on one Example of this invention. It is a figure which shows the main structures and schematic operation | movement of the display apparatus which concern on one Example of this invention. It is a flowchart figure which shows the whole process of the display apparatus which concerns on one Example of this invention. It is a figure which shows the specific example of the image generation process using the display apparatus which concerns on one Example of this invention. It is a figure which shows the variation of the image generation process using the display apparatus which concerns on one Example of this invention. It is a flowchart figure which shows the image generation process of the display apparatus which concerns on one Example of this invention. It is a flowchart figure which shows the surrounding area analysis process of the display apparatus which concerns on one Example of this invention. It is a flowchart figure which shows the character string analysis process of the display apparatus which concerns on one Example of this invention. It is a flowchart figure which shows the actual process of the display apparatus which concerns on one Example of this invention. It is a figure which shows an example of the search keyword storage table which concerns on one Example of this invention. It is a figure which shows an example of the analysis information storage table (default value) which concerns on one Example of this invention. It is a figure which shows an example of the analysis information storage table which concerns on one Example of this invention. It is a figure which shows an example of the analysis information storage table (user A) which concerns on one Example of this invention.

  As shown in the background art, using a display device equipped with a touch panel such as a tablet terminal and using an electronic conference application that operates on the device, a conference document or the like is displayed, or characters and the like are displayed on the displayed document with a touch pen Can be added.

  Here, for example, when an address is included in the displayed manuscript, a map near the address is displayed, and when the manuscript includes data, a graph in which the data is processed is displayed. When a URL is included in a document, the code information for reading the URL with a mobile terminal is displayed, thereby improving the convenience of the user viewing the document.

  However, it is difficult to add an image such as a map, a graph, or a URL with the conventional method. Even if it can be added, the process of converting text information such as addresses and data into image information such as maps and graphs must be performed by the user himself, and the operation is complicated. In addition, an accurate map or an accurate graph cannot be added by handwriting.

  Therefore, in one embodiment of the present invention, a method is proposed in which an image is automatically generated based on a character string displayed on a screen, and the generated image can be displayed superimposed on an image of a document. .

  For example, if an address is included in the manuscript and the address string is enclosed with a touch pen, a map near the address is automatically generated and displayed, or if the manuscript contains a numerical value, When a numeric character string is enclosed with a touch pen, a graph based on the numeric value is automatically generated and displayed, or when a URL is included in a manuscript, enclosing the URL character string with a touch pen causes the URL to be displayed. A coded QR code is automatically generated and displayed.

  Also, the method of enclosing the character string and the contents of the enclosed character string are analyzed, each user learns the desired image, and a well-converted image is automatically generated or well converted. Present image candidates on the screen.

  In order to describe the above-described embodiment of the present invention in more detail, a display device and a display control program according to an embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a diagram illustrating an example of a display device according to the present embodiment, and FIG. 2 is a diagram illustrating a main configuration and a schematic operation of the display device. FIG. 3 is a flowchart showing the overall processing of the display device of this embodiment, and FIGS. 4 and 5 are diagrams showing an example of image generation processing using the display device of this embodiment. FIGS. 6 to 9 are flowcharts showing details of the image generation processing of the display device of the present embodiment, and FIGS. 10 to 13 are diagrams showing examples of tables referred to in the image generation processing. is there.

  As illustrated in FIG. 1, the display device 10 according to the present exemplary embodiment includes a display device such as a tablet terminal, an electronic book, or a thin computer device. The display device 10 includes an area for displaying an image of an original (original display screen), an area for selecting an original to be displayed on the original display screen (original selection screen), selection of a pen for additional writing, color, and width. There is an area (pen selection control) for designating, etc., and when the pen / brush icon is clicked with the pen selection control, the pen / brush displayed on the original display screen can be added to the original. ing.

  FIG. 2 shows the main configuration and schematic operation of the display device 10. The display device 10 includes an image display component 11, an input / output management module 12, an input image analysis module 13, an image generation module 14, and an image. The display module 15, the image storage module 16, the communication unit 17, the analysis information storage unit 18, and the storage unit 19 are configured.

  The image display component 11 includes an operation unit such as a pressure-sensitive touch panel in which transparent electrodes are arranged in a grid on a display unit such as a liquid crystal display device or an organic EL (electroluminescence) display device. Further, the image display component 11 has an OCR (Optical Character Recognition) function, and can recognize characters constituting the document displayed on the display unit. When a predetermined graphic such as a rectangle or an ellipse is written using a touch pen or the like, the image display component 11 notifies the input / output management module 12 of a write event. Further, when an instruction to save is given using a touch pen or the like (the save button is touched), the image display component 11 notifies the image saving module 16 of a save event. The predetermined figure only needs to be able to specify an area, and may be a symbol such as “”, for example.

  When the input / output management module 12 detects a write event, the input / output management module 12 acquires the coordinates of the predetermined graphic from the image display component 11, specifies an area surrounded by the predetermined graphic (referred to as a write area), and displays an image. Using the OCR function of the display component 11, the character string displayed in the writing area is acquired, and the input image analysis module 13 is notified of the specified writing area information and the acquired character string information.

  When the input image analysis module 13 receives the write area information and the character string information from the input / output management module 12, the input image analysis module 13 analyzes the character string in the write area and stores information stored in advance in the analysis information storage unit 18 (described later). Based on the search keyword storage table, a keyword included in the character string is extracted, and a character string including the extracted keyword is searched from information stored in advance in the analysis information storage unit 18 (an analysis information storage table described later). Then, the image type corresponding to the searched character string is specified as the image type of the image to be generated. Further, the input image analysis module 13 acquires the size of the writing area, and searches for a writing area having a size close to the acquired size from information (an analysis information storage table described later) stored in advance in the analysis information storage unit 18. Then, the image type corresponding to the searched writing area is specified as the image type of the image to be generated. The input image analysis module 13 presents image conversion candidates and allows the user to select an image type. Then, the character string information is notified to the image generation module 14 that generates an image of the specified or selected image type.

  The image generation module 14 is a part that generates an image based on the character string information received from the input image analysis module 13, and in this embodiment, the code information generation module 14a, the graph generation module 14b, the map information generation module 14c, including. The code information generation module 14a is a module that operates when a character string is a URL. The code information generation module 14a generates a code information such as a QR code (registered trademark) or a barcode by encoding the URL using a known technique. The code information thus transmitted is transmitted to the image display module 15. The graph generation module 14b is a module that operates when the size of the writing area includes a character string of two or more lines. The graph generation module 14b acquires a numerical value from the character string and uses the numerical value to generate a pie chart, a line graph, A bar graph or the like is generated, and the generated graph is transmitted to the image display module 15. The map information generation module 14c is a module that operates when the character string is an address. The map information generation module 14c generates a map information by extracting a map in the vicinity of the address from a prestored map, and the generated map information is displayed as an image display module. 15 to send.

  The image display module 15 displays the document selected on the document selection screen on the document display screen, displays the pen image selected by the pen selection control on the document display screen, or is generated by the image generation module 14. An image (code information or graph or map information) is superimposed on the image of the document and displayed on the document display screen.

  When the storage event is detected, the image storage module 16 acquires composite image information (image information obtained by superimposing the generated image on the original image) displayed on the original display screen from the image display component 11, and the image Information is stored in the storage unit 19. When image information is downloaded from the Internet or the like via the communication unit 17, the downloaded image information is stored in the storage unit 19.

  The communication unit 17 is a NIC (Network Interface Card), a modem, or the like, and via a communication network such as a LAN (Local Area Network) or a WAN (Wide Area Network), an external device (for example, a server that stores document data, A server that provides image information, a printer that prints the displayed image information, and an image forming apparatus such as an MFP (Multi Function Peripheral) are connected.

  The analysis information storage unit 18 is a memory or HDD (Hard Disk Drive), and stores a search keyword storage table as shown in FIG. 10, an analysis information storage table as shown in FIGS. The result analyzed by the image analysis module 13 is reflected in the analysis information storage table as history information.

  The storage unit 19 is also a memory or an HDD, and stores image information acquired from the image display component 11, image information downloaded from the Internet or the like via the communication unit 17, and the like. The analysis information storage unit 18 and the storage unit 19 may be configured by using different storage areas of a single memory or HDD.

  In FIG. 2, the input / output management module 12, the input image analysis module 13, the image generation module 14, the image display module 15, and the image storage module 16 are configured as hardware. ) And a program (display control program) executed by a control unit including a memory such as a ROM (Read Only Memory) and a RAM (Random Access Memory).

  Next, the overall processing of the display device 10 having the above configuration will be outlined with reference to the flowchart of FIG.

  First, when the user operates the document selection screen of the display device 10 to select a document, the image display module 15 of the display device 10 displays the selected document on the image display component 11 (document display screen) (S101). ).

  Next, when the user operates the pen selection control of the display device 10 to select a pen and writes a predetermined figure so as to surround a predetermined character string of a document displayed using a touch pen or the like, an image display is performed. The component 11 detects writing of a predetermined graphic and notifies the input / output management module 12 of a write event notifying that the predetermined graphic has been written (S102). The method for writing the predetermined figure is not particularly limited, and the figure may be drawn by hand, or a rectangle may be drawn by specifying the start point and the end point.

  Next, the input / output management module 12 acquires the coordinates of a predetermined graphic from the image display component 11, specifies the writing area surrounded by the predetermined graphic, and converts the character string displayed in the writing area. It acquires (S103), and notifies the input image analysis module 13 of the specified writing area information and the acquired character string information.

  Upon receiving the notification, the input image analysis module 13 analyzes the character string, searches the analyzed character string with the keyword in the search keyword storage table (see FIG. 10) stored in the analysis information storage unit 18, and includes the character string. Keywords to be extracted are extracted (S104). Note that the input image analysis module 13 may also analyze the size of the writing area, but in this flow, the analysis of the size of the writing area will not be described for easy understanding.

  Next, the input image analysis module 13 searches the analysis information storage table (see FIGS. 11 to 13) stored in the analysis information storage unit 18 with the extracted keyword, and specifies the image type corresponding to the keyword (S105). ) Notify the image generation module 14 of the specified image type and character string information.

  Next, the image generation module 14 (code information generation module 14a, graph generation module 14b, or map information generation module 14c) corresponding to the specified image type generates an image corresponding to the specified image type from the character string information. (S106) Information on the generated image is notified to the image display module 15.

  Next, the image display module 15 superimposes and displays an image corresponding to the specified image type on the image of the document displayed on the image display component 11 (document display screen) (S107). The position for displaying the image corresponding to the specified image type is not particularly limited, but it is preferably displayed in the vicinity of the character string that is the source of the image (for example, the upper, lower, left, and right margin areas of the character string).

  Thereafter, the image storage module 16 acquires, from the image display component 11 (original display screen), information on a composite image obtained by superimposing an image corresponding to the specified image type on the original image, and stores the information on the composite image. The data is stored in the unit 19 (S108), and the series of processing ends.

  As described above, when a predetermined figure is written so as to surround a predetermined character string of the displayed document, the character string in the writing area is analyzed, and a keyword included in the character string is extracted and extracted. Since the image type corresponding to the keyword is specified, and the image corresponding to the specified image type is generated from the character string and displayed superimposed on the original, the user can obtain useful information related to the displayed original. Can do.

  Hereinafter, image generation processing for generating an image from a character string will be specifically described with reference to specific examples of FIGS. 4 and 5, flowcharts of FIGS. 6 to 9, and tables of FIGS. 10 to 13. FIG. 6 shows details of the processing from S104 to S106 in the flowchart of FIG. 3, and FIGS. 7 and 8 show details of the writing area analysis processing and character string analysis processing of FIG. 6, respectively. ing.

[Image generation processing]
As shown in FIG. 6, when the input image analysis module 13 acquires the writing area information and the character string information from the input / output management module 12, the input image analysis module 13 analyzes the character string in the writing area (S210).

  Next, the vertical and horizontal sizes of one character are acquired (S220). In addition, when the size of each character which comprises a character string differs, the size used by the most characters, the size of the smallest character, the size of an average character, etc. are acquirable.

  Next, the input image analysis module 13 compares the vertical size of the writing area with the vertical size of one character (S230). Note that when the writing area is handwritten, the vertical size of the writing area is not constant, but in that case, the dimension of the part with the smallest interval or the dimension of the part with the average interval should be the vertical size. Can do.

  Then, the input image analysis module 13 determines whether or not the vertical size of the writing area is at least twice the vertical size of one character (that is, the character string has a plurality of lines) (S240). In the case of (for example, a character string indicating the download time in FIG. 4), the writing area analysis process is performed to specify the image type (S250), and the character string is one line (for example, a character string indicating the address in FIG. In the case of a character string indicating a URL), a character string analysis process is performed to identify the image type (S260).

[Write area analysis processing]
FIG. 7 is a flowchart showing details of S250 in FIG. In the writing area analysis process, the input image analysis module 13 searches the writing area information described in the analysis information storage table for a thing close to the vertical and horizontal sizes of the specified writing area (those having substantially the same size) ( S251). This search can be executed by, for example, a SELECT statement of SQL (Structured Query Language).

  In the initial state, the analysis information storage table has a configuration as shown in FIG. 11 and no writing area information is recorded. Therefore, it is not possible to search for an area close to the vertical and horizontal sizes of the writing area. When the image generation processing of the example is repeated, the analyzed character string, the writing area information of the character string, and the image type of the image generated from the character string are registered in the analysis information storage table, and the configuration as shown in FIG. As a result, it is possible to search for a size close to the vertical and horizontal sizes of the writing area.

  Next, the input image analysis module 13 determines whether any of the write area information registered in the analysis information storage table is close to the specified horizontal and vertical size of the write area (S252). If there is a size that is close to the vertical and horizontal size of the specified writing area, there is a high possibility that it will be converted to the same type of image. Therefore, if necessary, the image type corresponding to the writing area information (an image converted in the past) Type) is displayed as an image conversion candidate (S253). On the other hand, if there is no size that is close to the vertical and horizontal size of the specified writing area, it is impossible to determine which type of image should be converted, so a plurality of image conversion candidates for allowing the user to select the image type are displayed (S254). ). In addition, when there are a plurality of writing area information close to the vertical and horizontal sizes of the specified writing area and there are a plurality of image types corresponding to the writing area information, a plurality of image conversion candidates may be displayed. The image types can be displayed in descending order of the number of writing area information.

  Then, the input image analysis module 13 specifies the image type converted in the past or the image type selected by the user from the image conversion candidates as the image type for converting the character string (S255). The character string information is notified to the corresponding image generation module 14.

[String analysis processing]
FIG. 8 is a flowchart showing details of S260 of FIG. In the character string analysis process, the input image analysis module 13 searches the analyzed character string with a keyword in the search keyword storage table (S261). This search can also be executed with the SQL SELECT statement. For example, when writing as shown in FIG. 9A is performed, the character string in the writing area is recognized as “Kami Ochiai 231-1, Atsugi-shi, Kanagawa” as shown in FIG. As shown in (c) and (d), keywords are sequentially searched from the search keyword storage table. Specifically, when a search keyword storage table as shown in FIG. 10 is registered, “Kanagawa” of keyword 3, “prefecture” of keyword 4, and “city” of keyword 6 are searched.

  Next, the input image analysis module 13 determines whether a keyword is found in the character string (S262). If a keyword is found, the analysis information storage table is searched with the corresponding keyword (S263). This search can also be executed with the SQL SELECT statement. For example, when the analysis information storage table has the configuration shown in FIG. 12, six IDs of 2, 4, 6, 8, 9, 10 are searched.

  Next, the input image analysis module 13 determines whether the number of search results is large (S264). If there are many search results, there is a high possibility of conversion to the same type of image. The image types converted in the past are displayed as image conversion candidates (S265). For example, in the above example, as shown in FIG. 9 (e), 6 out of all 13 cases in the analysis information storage table are applicable, so in FIG. ) As a candidate. On the other hand, when there are few search results, it is difficult to determine which type of image to convert, and therefore image type candidates for allowing the user to select an image type are displayed (S266). For example, as shown in FIG. 5A, when writing is performed so as to surround the URL, a plurality of image conversion candidates as shown in FIG. 5B are displayed. When there are many search results and there are a plurality of image types corresponding to the search results, a plurality of image conversion candidates may be displayed. Further, when displaying a plurality of image conversion candidates, the image types can be displayed in the order of the number of search results.

  Then, the input image analysis module 13 specifies the image type converted in the past or the image type selected by the user from the image conversion candidates as the image type for converting the character string (S267). The character string information is notified to the corresponding image generation module 14. For example, in FIG. 9F, when the map is displayed as the image type converted in the past, the input image analysis module 13 notifies the map information creation module 14c of the character string information. When the user selects “QR code generation” from the image conversion candidates as shown in FIG. 5B, the input image analysis module 13 notifies the code information generation module 14a of the character string information. .

  Returning to the flowchart of FIG. 6, the image generation module 14 (code information generation module 14a, graph generation module 14b, or map information generation module 14c) corresponding to the specified image type is specified from the notified character string information. An image corresponding to the image type is generated (S270). For example, when the user selects “QR code generation” in the image conversion candidate of FIG. 5B, the code information generation module 14a generates a QR code as shown in FIG. 5C.

  The analysis information storage table may be provided for each device as shown in FIG. 12, but may be provided for each user as shown in FIG. 13, and by using the analysis information storage table for each user, It is possible to reliably generate an image desired by the user.

  The present invention is not limited to the above-described embodiments, and the configuration and control thereof can be changed as appropriate without departing from the spirit of the present invention. For example, in the above embodiment, the map, the graph, and the code information are exemplified as the image type, but any image that can be converted from a character string may be used.

  The present invention is applicable to a display device including a touch panel that can be input with a touch pen or the like, and a display control program that operates on the display device.

DESCRIPTION OF SYMBOLS 10 Display apparatus 11 Image display component 12 Input / output management module 13 Input image analysis module 14 Image generation module 14a Code information generation module 14b Graph generation module 14c Map information generation module 15 Image display module 16 Image storage module 17 Communication part 18 Analysis information storage Part 19 Storage part

Claims (8)

A display device having a screen for displaying an image of a document, and having a function of recognizing characters in the document displayed on the screen and a function of recognizing a graphic written on the screen with a touch pen ,
When a graphic is written on the screen on which the image of the document is displayed, an input / output management unit that identifies a writing area defined by the graphic and acquires a character string displayed in the writing area;
Analyzing the acquired character string, specifying an image type of an image to be generated based on the character string, or an input image analysis unit that displays candidates for allowing the user to select the image type;
An image generation unit that generates an image of the specified image type based on the acquired character string;
An image display unit, comprising: an image display unit that displays the generated image superimposed on the image of the document displayed on the screen. A table that associates a previously acquired character string with an image type of an image generated based on the character string is stored in advance,
The input image analysis unit extracts a predetermined keyword from the acquired character string, searches a character string including the extracted keyword from the table, and generates an image type corresponding to the searched character string The display device according to claim 1, wherein the display device is specified as an image type of an image. A table is previously stored that associates the previously acquired character string with the size of the writing area defined by the previously written graphic and the image type of the image generated based on the character string,
The input image analysis unit acquires the size of a writing area defined by the written graphic, searches the table for a writing area having a size substantially equal to the acquired size, and corresponds to the searched writing area The display device according to claim 1, wherein the type is specified as an image type of an image to be generated.   The input image analysis unit searches the table for a plurality of character strings including the keyword or a writing area having a size close to the acquired size, and there are a plurality of image types corresponding to the searched character strings or writing areas. 4. The display device according to claim 2, wherein a plurality of image type candidates are displayed in descending order of the number of searches. Operates on a display device having a screen for displaying an image of a document and having a function of recognizing characters in the document displayed on the screen and a function of recognizing a graphic written on the screen with a touch pen A display control program,
The display device;
When a figure is written on the screen on which the image of the document is displayed, an input / output management unit that identifies a writing area defined by the figure and acquires a character string displayed in the writing area;
Analyzing the acquired character string, specifying an image type of an image to be generated based on the character string, or an input image analysis unit for displaying a candidate for allowing the user to select the image type,
An image generation unit that generates an image of the specified image type based on the acquired character string,
A display control program that functions as an image display unit that displays the generated image superimposed on the image of the document displayed on the screen. A table that associates a previously acquired character string with an image type of an image generated based on the character string is stored in advance,
The input image analysis unit extracts a predetermined keyword from the acquired character string, searches a character string including the extracted keyword from the table, and generates an image type corresponding to the searched character string The display control program according to claim 5, wherein the display control program is specified as an image type of an image. A table is previously stored that associates the previously acquired character string with the size of the writing area defined by the previously written graphic and the image type of the image generated based on the character string,
The input image analysis unit acquires the size of a writing area defined by the written graphic, searches the table for a writing area having a size substantially equal to the acquired size, and corresponds to the searched writing area The display control program according to claim 5, wherein the type is specified as an image type of an image to be generated.   The input image analysis unit searches the table for a plurality of character strings including the keyword or a writing area having a size close to the acquired size, and there are a plurality of image types corresponding to the searched character strings or writing areas. 8. The display control program according to claim 6, wherein a plurality of image type candidates are displayed in descending order of the number of searches.

Images