JP2014089728A - Input support device, input support method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To increase efficiency of an input of a character string referring to an image.SOLUTION: An input support system 10 includes: a scan data storage unit 131 for storing scan data for displaying a form image; a cursor definition storage unit 132 for storing cursor definition information showing a cursor area; a form image display unit 112 for displaying a view 202 of a form image based on the scan data; and an image cursor display unit 113 for displaying an image cursor 204. When a cursor area is not included in a view area, the form image display unit 112 changes the view area so as to include the cursor area in the view area and displays a view included in the changed view area.

Description

  The present invention relates to an input support device, an input support method, and a program.

  While an operator refers to an image captured from a scanner or the like, a character string displayed on the image is input to a computer, or a character string read from the image by OCR is corrected. In order to increase the efficiency of such input work, for example, Patent Document 1 proposes to process and display a partial image corresponding to an input field on image data obtained by reading a slip.

Japanese Patent Laid-Open No. 5-303661

  For a form with many items, it is often difficult to see the items when the whole is displayed on the screen, so only a part of the image is often displayed. However, Patent Document 1 is based on the premise that the entire image data is displayed, and it is difficult to refer to the entered contents in a slip having many items.

  The present invention has been made in view of such a background, and an object thereof is to provide an input support apparatus, an input support method, and a program capable of improving the efficiency of inputting a character string referring to an image. .

  A main invention of the present invention for solving the above problems is an apparatus that supports input of a character string drawn in an image, and an image data storage unit that stores image data for displaying the image; On the image, a character string area information storage unit for storing character string area information for specifying a character string area that is an area in which the character string to be input is drawn, and is displayed on the screen among the images. An image display unit that displays a partial image included in a view region that is a partial region, and an image cursor display unit that displays the character string region specified by the character string region information so as to be distinguishable from other regions; The image display unit changes the view area so that the character string area is included in the view area when the view area does not include the character string area, and the changed And displaying the partial image included in-menu region.

  According to the input support system of the present invention, it is possible to distinguish an area where a character string is drawn in an image from other areas, so that an operator can easily refer to a character string to be input. Therefore, the input efficiency of the character string is improved. Further, in the input support system of the present invention, when the character string area is not included in the view area, that is, when the character string is not displayed as a partial image, the view area is included so that the character string area is included in the view area. Therefore, the character string to be referred to can be reliably displayed as a part of the partial image. Therefore, it is possible to save the trouble of searching where the character string to be referred to is displayed, so that the input efficiency of the character string can be further improved.

The input support apparatus of the present invention includes an input field display unit that displays a plurality of input fields for inputting the character string on a screen, and a focus detection unit that detects that the input field has acquired focus. The character string area information storage unit further stores, for each input field, the character string area information for specifying the character string area in which the character string to be input to the input field is drawn. The image cursor display unit reads the character string region information corresponding to the input field that has acquired the focus from the character string region information storage unit, and the character string specified by the read character string region information The area may be displayed so as to be distinguishable from the other areas.
In this case, the place that the input person should refer to in the image can be emphasized according to the focus of the input field. Therefore, the input efficiency can be further improved.

  In the input support device according to the aspect of the invention, the image display unit may include the first character string region specified by the first character string region information corresponding to the first input field that has acquired the focus. If not included in the view area, the first character string from the second character string area specified by the second character string area information corresponding to the second input field that has lost the focus An offset to the area may be calculated, and the position of the view area may be changed according to the offset.

  In the input support device of the present invention, the character string area may be a rectangle, and the character string area information may include a coordinate value indicating a reference point of the rectangle and a width and a height of the rectangle.

The input support apparatus according to the present invention further includes an image operation instruction input unit that receives an image operation instruction including enlargement, reduction, rotation, and movement of the image, and the image display unit applies the image data to the image data. Applying the image operation, extracting and displaying the partial image included in the view area from an image based on the image data to which the image operation is applied, and the image cursor display unit according to the image operation The character string area may be displayed so as to be distinguishable from the other areas.
In this case, the location to be referred to can be displayed so as to be distinguishable from other regions in conjunction with image operations such as enlargement, reduction, rotation, and movement of the image. Therefore, the operator can surely grasp the area to be referred to.

In the input support device of the present invention, the image cursor display unit creates a transparent panel that overlaps the partial image, and draws a graphic indicating the character string area on the created transparent panel. Also good.
In this case, since it is only necessary to draw a graphic on the transparent panel, it is possible to emphasize the place to be referred to without editing the original image. In addition, when image operations such as enlargement, reduction, rotation, and movement are performed on the original image, general image processing only needs to be performed, so that it is not necessary to prepare a special image processing routine, thereby improving development efficiency. be able to.

In the input support device of the present invention, the image display unit is realized by executing a program defined by a first class of an object-oriented programming language, and the image cursor display unit is configured by the first class. It may be realized by executing a program defined by a second class that inherits.
In this case, when there is a first class that displays a part of an image, a second class that includes a method that inherits the first class and displays a graphic indicating a character string area on the image. Thus, it is only necessary to develop a method for displaying a graphic indicating a character string area while using a method related to image processing that has been implemented in the first class, so that development efficiency can be improved.

The input support apparatus according to the present invention may further include a character recognition processing unit that recognizes the character string described in the character string area specified by the character string area information by OCR processing.
In this case, the input by the input person can be omitted for character strings that can be recognized by OCR. Therefore, the input efficiency can be further improved. Moreover, since the input person can put effort into the confirmation work of input contents, such as correcting a recognition error, a reduction in input mistakes is expected.

In the input support device of the present invention, the image data storage unit stores the category of the image in association with the image data, and the character string region information storage unit associates the category with the category. The image display unit further stores an image designation unit that stores character string region information and accepts designation of the image data, and the image display unit includes the partial image included in the view region from the image based on the designated image data. The image cursor display unit reads the category corresponding to the designated image data from the image data storage unit, and the character string region information corresponding to the read category is the character string. Read from the area information storage unit and display the graphic representing the character string area specified by the read character string area information. It may be.
In this case, the figure can be adjusted according to the form of the form. Therefore, even when input is performed while referring to data in various formats, it is possible to input efficiently.

Further, in the input support device of the present invention, the image analysis for determining the category by analyzing the image data captured from the scanner and connected to a scanner that reads the form on which the category is printed and outputs the image data. And an image registration unit that associates the category determined by the image analysis unit with the image data and registers the image data in the image data storage unit.
In this case, it is possible to recognize the category printed on the form and change the position and size of the graphic that emphasizes the character string area. Therefore, if the category is printed on the form, it is possible to highlight the character string area immediately after reading the form with the scanner after filling in the characters. For example, in a window service that accepts forms related to multiple services, Efficiently entered characters can be entered.

  According to another aspect of the present invention, there is provided a method for supporting input of a character string drawn on an image, the step of storing image data for displaying the image, and input on the image Storing character string area information for specifying a character string area that is an area in which the character string is drawn; and a partial image included in a view area that is a partial area of the image based on the image data Displaying the graphic representing the character string area specified by the character string area information, and the step of displaying the partial image includes the character string area in the view area. If not, changing the view area so that the character string area is included in the view area, and displaying the partial image included in the changed view area And Mukoto.

  According to another aspect of the present invention, there is provided a program for supporting input of a character string drawn on an image, wherein the computer stores image data for displaying the image; Storing character string area information for specifying a character string area, which is an area in which the character string to be input is drawn, on the image; and A step of displaying a partial image included in a view area, which is a part area, and a step of displaying a graphic representing the character string area specified by the character string area information. In the step of displaying an image, when the character string area is not included in the view area in the computer, the character string area is Serial change the view region to be included in the view area, and thereby the further execution step of displaying the partial image included in the view area described above changes.

  Other problems and solutions to be disclosed by the present application will be made clear by the embodiments of the invention and the drawings.

  According to the present invention, it is possible to improve the efficiency of inputting a character string referring to an image.

It is a figure which shows an example of the screen 20 which the input assistance system 10 displays. It is a figure which shows an example of the screen 20 at the time of displaying the image cursor 204. FIG. It is a figure which shows an example of the screen 20 at the time of enlarging a form image. 2 is a diagram illustrating a hardware configuration example of an input support system 10. FIG. 2 is a diagram illustrating an example of a software configuration of an input support system 10. FIG. It is a figure which shows the structural example of the cursor definition information registered into the cursor definition memory | storage part 132. FIG. FIG. 6 is a diagram illustrating a state in which an image cursor 204 is drawn on a cursor panel that is overlaid on a form image 22. 3 is a diagram illustrating a configuration example of an input data storage unit 133. FIG. 4 is a diagram illustrating a flow of processing executed in the input support system 10. FIG. It is a figure explaining an initialization process. It is a figure explaining the process which redraws the image cursor 204 according to the change of a focus. It is a figure explaining a scroll process. FIG. 6 is a diagram illustrating a flow of drawing processing of an image cursor 204. It is a figure explaining the process which expands or reduces the form image. It is a figure explaining the process which rotates the form image.

  The input support system 10 according to an embodiment of the present invention displays an image obtained by reading a handwritten form with a scanner (hereinafter referred to as a form image) and displays characters of each input item displayed on the form image by the operator. It helps to input a column.

  FIG. 1 is a diagram illustrating an example of a screen 20 displayed by the input support system 10 of the present embodiment. In the example of FIG. 1, all or part of the form image (hereinafter, part or all of the form image displayed in the display field 201 is referred to as a view 202) is displayed in the display field 201 on the left side of the screen 20. Yes. The form has entry fields corresponding to the input items, and an input field 203 corresponding to each input item is displayed on the right side. The operator refers to the form image view 202 and inputs a character string displayed in the form image into the input field 203. When the end button 211 is pressed, the input process ends.

  One input field 203 is selected on the screen 20 by clicking on the input field 203 with the mouse or operating the keyboard, and only the input field 203 can be input from the keyboard. The state where the input field 203 is ready for input is called focus. In the input support system 10 of the present embodiment, when the input field 203 acquires the focus, as shown in FIG. 2, a figure (hereinafter referred to as an image) showing the area of the entry field on the form corresponding to the input field 203 that has acquired the focus. A cursor 204) is displayed superimposed on the view 202 of the form image. By displaying the image cursor 204 on the form image in this way, it becomes possible for the input person to easily grasp where the input should be made, and the input efficiency is improved.

  An enlarge button 205, a reduce button 206, a left rotate button 207, and a right rotate button 208 are provided below the display field 201 of the screen 20. When these buttons are pressed, the form image is enlarged, reduced, or rotated. The image cursor 204 is also enlarged, reduced, and rotated in accordance with the enlargement, reduction, and rotation of the form image. FIG. 3 is a diagram for explaining a state in which a form image is enlarged and displayed. In the example of FIG. 3, the form image view 202 displays only a part of the form image. The image cursor 204 is also enlarged and displayed in accordance with the enlargement of the form image.

  On the screen 20, a horizontal scroll bar (hereinafter referred to as a horizontal scroll bar 209) and a vertical scroll bar (hereinafter referred to as a vertical scroll bar 210) are respectively provided at the lower end and the right end of the display column 201. The form image is moved (scrolled) in the horizontal direction and the vertical direction in accordance with these operations. The image cursor 204 is also moved in accordance with the scroll of the form image. Thereby, the entry column on the form can be adjusted and displayed so that the operator can easily see it. Details will be described below.

  FIG. 4 is a diagram illustrating a hardware configuration example of the input support system 10 of the present embodiment. The input support system 10 is assumed to be realized by a computer such as a personal computer, a smartphone, or a PDA (Personal Digital Assistant) operated by an input person who inputs data. The input support system 10 includes a CPU 101, a memory 102, a storage device 103, a keyboard 105, a mouse 106, a display 107, and a scanner 108. The storage device 103 stores various data and programs, such as a hard disk drive, a solid state drive, and a flash memory. The CPU 101 implements various functions by reading a program stored in the storage device 103 into the memory 102 and executing it. The keyboard 105 and the mouse 106 receive data input from an input person who operates the input support system 10. The display 106 outputs data. A scanner 208 reads a handwritten form and outputs it as image data.

  FIG. 5 is a diagram illustrating a software configuration example of the input support system 10. The input support system 10 includes a scan data registration unit 111, a form image display unit 112, an image cursor display unit 113, an image operation instruction input unit 114, a data input unit 115, a scan data storage unit 131, a cursor definition storage unit 132, input data A storage unit 133 is provided. The scan data registration unit 111, the form image display unit 112, the image cursor display unit 113, the image operation instruction input unit 114, and the data input unit 115 are programs stored in the storage device 103 by the CPU 101 included in the input support system 10. The scan data storage unit 131, the cursor definition storage unit 132, and the input data storage unit 133 are realized as part of a storage area provided by the memory 102 and the storage device 103. .

  The scan data storage unit 131 stores image data for displaying a form image (hereinafter referred to as scan data). The scan data storage unit 131 can be realized, for example, as a file system folder (directory) provided by an operating system operating in the input support system 10. In this case, the scan data can be managed as an image file, for example. The scan data storage unit 131 is not limited to this, and may be realized as a table managed by, for example, a relational database management system (RDBMS).

  The scan data registration unit 111 controls the scanner 108 to acquire form image data read by the scanner 108, and registers the scan data in the scan data storage unit 131. The scan data is assumed to be in a bitmap image format such as TIFF, Jpeg, GIF, or PNG, and the image size (width and height) can be acquired from the scan data. In this embodiment, it is assumed that the scanner 108 outputs data in Jpeg format, and the scan data registration unit 111 registers the data output from the scanner 108 in the scan data storage unit 131 as it is. Note that the scan data registration unit 111 may convert the data output from the scanner 108 into image data in the above format.

  The form image display unit 112 displays a view 202 of the form image in the display column 201 based on the scan data. The form image display unit 112 can also perform image operations such as enlargement, reduction, movement, and rotation on the form image in accordance with an instruction from the operator. In the present embodiment, the form image display unit 112 creates an image obtained by performing an image operation on scan data (hereinafter referred to as processed data), stores it in the memory 102, and generates a form image based on the processed data. indicate. The form image display unit 112 displays only a part of the form image as the view 202 in the display field 201 according to the size of the display field 201. Note that the form image display unit 112 can display a form image using an image display process based on general image data.

  The cursor definition storage unit 132 stores information for displaying the image cursor 204 (hereinafter referred to as cursor definition information). FIG. 6 is a diagram illustrating a configuration example of the cursor definition information registered in the cursor definition storage unit 132. The cursor definition information includes information specifying an input item (hereinafter referred to as input item ID) and the shape of the image cursor 204 corresponding to the input field 203 (that is, an entry field corresponding to the input item on the form image). Information (hereinafter referred to as character string region information). In this embodiment, the image cursor 204 is assumed to be a rectangle, and a rectangle specified by the character string area information (hereinafter, an area surrounded by the image cursor 204 is referred to as a cursor area, which corresponds to the character string area of the present invention). The position is specified by the position on the form image created at the same magnification rate based on the scan data. That is, the upper left corner of a form image with the same magnification is (0, 0), and in the coordinate system increasing in the right direction and the lower direction, the coordinates of the upper left corner of the rectangle are (X, Y), and the horizontal (X It is assumed that the character string region information is expressed by (X, Y, W, H) where the width in the axial direction is W and the height in the vertical (Y) axial direction is H.

  In the following description, it is assumed that not only the area surrounding the entry field on the form image but also all the various areas are rectangles. For the rectangle, “(the X coordinate of the upper left corner of the rectangle, the Y coordinate of the upper left corner of the rectangle) Coordinates, rectangle width, rectangle height) ”.

  The image cursor display unit 113 draws the image cursor 204 superimposed on the view 202 of the form image based on the cursor definition information. In the present embodiment, two panels (also referred to as layers) are created to draw an image in the display field 201 of the screen 20, and the form image display unit 112 draws the form image view 202 on one panel. At the same time, the image cursor display unit 113 draws the image cursor 204 on the other panel. When the focus of the input field 203 is changed on the screen 20, the image cursor display unit 113 redraws the image cursor 204 based on the cursor definition information corresponding to the input field 203 that has acquired the focus.

  A panel for drawing the image cursor 204 (hereinafter referred to as a cursor panel) is transparent, and is superimposed on a panel for drawing the view 202 of the form image (hereinafter referred to as a view panel) as shown in FIG. As a result, the image cursor display unit 113 can draw the image cursor 204 without processing the view 202 of the form image. In addition, the form image display unit 112 can draw the image cursor 204 while superimposing the image cursor 204 on the form image using a general drawing routine on the panel. Note that the panel can be mounted using, for example, JPanel in the Java (registered trademark) language. The cursor panel may be the same size as the view panel as shown in FIG. 7, and the image cursor display unit 113 may draw a rectangle on the cursor panel. As the size of the rectangle, the rectangle may be expressed by coloring the boundary line of the cursor panel.

  The data input unit 115 receives an input of a character string input in the input field 203 of the screen 20 and registers the received character string in the input data storage unit 133. FIG. 8 is a diagram illustrating a configuration example of the input data storage unit 133. In the example of FIG. 8, the data input unit 115 manages the character string input in the input field 203 as an input value in association with the input item ID. The data input unit 115 does not register the character string input in the input field 203 in the input data storage unit 133, but may notify other applications, for example, or set the character string in another computer. You may make it transmit the message which carried out.

  The image operation instruction input unit 114 receives an instruction for image operation such as enlargement, reduction, movement, and rotation of the form image from the operator.

  FIG. 9 is a diagram for explaining the flow of processing executed in the input support system 10 of this embodiment. In the input support system 10 of the present embodiment, the initialization process shown in FIG. 10 is first performed (S31). Thereafter, when the focus of the input field 203 is changed (S32: YES), the focus change process shown in FIG. 11 is performed (S33), and at least one of the horizontal scroll bar 209 and the vertical scroll bar 210 is operated. In the case where it is detected (S34: YES), the scroll process of FIG. 12 is performed to move the view area (S35). When the enlargement button 205 or the reduction button 206 is pressed (S36: YES), the enlargement / reduction process shown in FIG. 14 is performed (S37), and when the left rotation button 207 or the right rotation button 208 is pressed, (S38: YES), the rotation process shown in FIG. 15 is performed (S39). If the end button 211 is not pressed (S40: NO), the processing from step S32 is repeated, and if the end button 211 is pressed (S40: YES), the character string input in the input field 203 is stored as input data. Registered in the unit 133 (S41).

  In the initialization process of FIG. 10, the form image display unit 112 sets the range of the view 202 (hereinafter referred to as a view area) on the form image, the upper left corner coordinates of the view 202 as (VX, VY), and The width is VW and the height of the view 202 is VH, and is initialized to (0, 0, 700, 900) (S3101). In this embodiment, the width of the display field 201 is 700 and the height of the display field 201 is 900. However, the present invention is not limited to this value, and the values of VW and VH are set according to the size of the screen 20. Can do.

  Next, the image cursor display unit 113 sets 0 to (CX, CY, CW, CH) indicating the cursor area in which the image cursor 204 is drawn (S3102). The form image display unit 112 sets, as an initial value, an enlargement ratio at which the entire form image can be displayed in the display column 201 (S3103). When the sizes of all the scan data stored in the scan data storage unit 131 are the same, a predetermined value (0.1 in the example of FIG. 10) is set to the initial value of the enlargement ratio as in the example of FIG. Can be set as a value. When the sizes of the scan data are different, for example, the smaller one of the quotient obtained by dividing the width of the scan data by VW and the quotient obtained by dividing the height of the scan data by VH may be set as the initial value of the enlargement ratio. it can.

  The form image display unit 112 initializes the rotation angle of the form image to 0 degrees (S3104), reads the scan data from the scan data storage unit 131, and enlarges or reduces the read scan data at the enlargement rate to obtain the processed data. (S3105). The form image display unit 112 may receive an input of a file name from an operator, for example, and read scan data indicated by the received file name, or may read the scan data in a predetermined order. Note that general image processing can be applied to enlargement or reduction processing of scan data.

  The image cursor display unit 113 creates a transparent panel for the image cursor 204 (S3106), and the form image display unit 112 extracts the view area view 202 from the form image based on the processed data and displays it in the display column 201. It is displayed (S3107).

  In the focus change process of FIG. 11, the image cursor 204 is redrawn in accordance with the focus change. The image cursor display unit 113 acquires an input item ID indicating the input field 203 that has acquired the focus (S3301). For example, an input item ID is attached to each input field 203, and the focus management process such as an operating system, a window management system operating on the operating system, or a Java (registered trademark) virtual machine is used. Information indicating the input field 203 from which the focus has been acquired can be acquired, and an input item ID attached to the acquired input field 203 can be acquired. The image cursor display unit 113 reads the cursor definition information corresponding to the acquired input item ID from the cursor definition storage unit 132 (S3302), and stores the character string region information included in the cursor definition information in CX, CY, CW, and CH. (X, Y, W, H) are respectively set (S3303).

  The image cursor display unit 113 determines whether or not the cursor area is included in the view area (S3304). The image cursor display unit 113 has an X coordinate value (VX + VW) at the right end of the view area that is equal to or greater than an X coordinate value (CX + CW) at the right end of the cursor area, and a Y coordinate value (VY + VH) at the lower end of the view area. It is determined whether or not the cursor area is included in the view area depending on whether or not the Y coordinate value (CY + CH) of the lower end of the cursor is greater than or equal to. When the cursor area is not included in the view area (S3304: NO), the image cursor display unit 113 displays CX on the horizontal scroll bar 209 so that the coordinates of the upper left corner of the view area are (CX, CY). Then, CY is set in the vertical scroll bar 210, and the scroll process shown in FIG. 12 is executed (S3305). If the cursor area is included in the view area (S3304: YES), the drawing process of the image cursor 204 shown in FIG. 13 is performed (S3306).

  In the scroll process of FIG. 12, the view area is moved and the view 202 is redrawn. The form image display unit 112 acquires the value of the horizontal scroll bar 209 and sets it as VX (S3501), and acquires the value of the vertical scroll bar 210 and sets it as VY (S3502). The form image display unit 112 extracts the image of the view area from the scan data and displays the view 202 on the view panel (S3503). The image cursor display unit 113 performs display processing of the image cursor 204 in FIG. 13 (S3504).

  In the process of FIG. 13, an image cursor 204 is displayed. The image cursor display unit 113 deletes the image cursor 204 on the cursor panel (S51). The image cursor display unit 113 subtracts VX and VY from values obtained by multiplying each of CX and CY by an enlargement ratio, and calculates coordinates (x, y) in the coordinate system with the upper left corner of the view area as a reference point. (S52) The width w and height h of the image cursor 204 are calculated by multiplying each of CW and CH by the enlargement ratio (S53). The image cursor display unit 113 draws a rectangle (x, y, w, h) (S54). The image cursor display unit 113 may draw the boundary line of the cursor panel, for example, by setting the cursor panel to the position and size of (x, y, w, h).

  In the enlargement / reduction processing of FIG. 14, the form image is enlarged or reduced and displayed. The image operation instruction input unit 114 receives an input of an enlargement ratio from the operator (S3701). For example, when the enlargement button 205 on the screen 20 is pressed, the image operation instruction input unit 114 adds a predetermined step value (for example, an arbitrary value such as 0.05 or 0.1) to the enlargement rate, When the reduction button 206 is pressed, the step value can be subtracted from the enlargement ratio. The form image display unit 112 reads the scan data from the scan data storage unit 131, and enlarges or reduces the read scan data at an enlargement ratio to obtain processed data (S3702). The form image display unit 112 extracts the view area view 202 from the form image based on the processed data and displays it in the display column 201 (S3703), and the image cursor display unit 113 performs the processing of FIG. Is drawn (S3704).

  In the rotation processing of FIG. 15, the form image is rotated and drawn, and the image cursor 204 is also rotated and drawn.

  The image operation instruction input unit 114 receives an input of the rotation angle from the operator (S3901). In the present embodiment, the rotation of the form image is assumed to be any one of 0 degree, 90 degrees, 180 degrees, and 270 degrees. For example, when the left rotation button 207 on the screen 20 is pressed, the image operation instruction input unit 114 subtracts 90 degrees from the rotation angle, adds 360 degrees when the rotation angle is less than 0 degrees, and rotates right. When the button 208 is pressed, the rotation angle can be calculated by adding 90 degrees to the rotation angle and subtracting 360 degrees when the rotation angle reaches 360 degrees or more.

  The image cursor display unit 113 sets CX, CY, CW, and CH to x, y, w, and h, respectively (S3902). When the rotation angle is 90 degrees (S3903: YES), the image cursor display unit 113 subtracts the sum of y and h from the height of the processed data, and x, h, and w are CX, CY, CW, and CH, respectively. (S3904). When the rotation angle is 180 degrees (S3905: YES), the image cursor display unit 113 subtracts the sum of x and w from the width of the machining data and the sum of y and h from the height of the machining data. The values are set to CX and CY, respectively (S3906). When the rotation angle is 270 degrees (S3907: YES), the image cursor display unit 113 sets y, the value obtained by subtracting the sum of x and w from the width of the processed data, and h and w as CX, CY, CW and CH are set (S3908).

  The form image display unit 112 reads the scan data from the scan data storage unit 131, enlarges or reduces the read scan data at an enlargement rate, and rotates the image at a rotation angle clockwise as processed data (S3909). Based on the data, the view area view 202 is extracted from the form image and displayed in the display column 201 (S3910). The image cursor display unit 113 redraws the image cursor 204 by the process of FIG. 13 (S3711).

  As described above, according to the input support system 10 of this embodiment, among the form images displayed in the display column 201, the entry column corresponding to the input item is distinguished from other regions by the image cursor 204. Can be. Therefore, for example, an operator who inputs a character string by referring to a form image, such as a bank clerk who inputs a transfer destination and a transfer amount upon receipt of a transfer slip, has a lot of information on one sheet. Even in a form that has input items, it is possible to easily recognize where the character string to be referenced is entered in the form image. Thereby, the input efficiency of the operator can be improved.

  Further, according to the input support system 10 of the present embodiment, the image cursor 204 can be moved to the position of the entry field corresponding to the input field 203 in response to the focus of the input field 203 being changed. Therefore, the character string to be input can be surely emphasized by the image cursor 204.

  Furthermore, when the cursor area is not included in the view area, the position of the view area with respect to the form image (offset from the coordinates of the upper left corner) can be adjusted so that the cursor area is included in the view area. Therefore, even if the entry column of the character string corresponding to the input field 203 is a part that is not displayed in the view 202 of the form image due to the focus change, the entry field is surely displayed in the view 202. Can be. Therefore, the operator does not lose sight of the cursor area emphasized by the image cursor 204, so that the character string can be input efficiently.

  Further, according to the input support system 10 of the present embodiment, the position and size of the image cursor 204 can be changed in conjunction with enlargement, reduction, rotation, and scrolling of the form image. Therefore, it is possible to adjust the position, size, and angle so that the form image can be easily viewed while emphasizing the place to be referred to by the image cursor 204. Therefore, the input efficiency of the character string by the operator can be improved.

  Further, in the input support system 10 of this embodiment, a transparent cursor panel is created separately from the form image and the image cursor 204 is drawn on the cursor panel, so that the form image itself is edited. The cursor area can be highlighted without doing it. Therefore, while highlighting the cursor area, it is possible for the operator to check the state as it is written on the form, and it is difficult to see the written character string by editing the image. It can be avoided.

  In the present embodiment, the input support system 10 is realized by a single computer, but may be configured by a plurality of computers. For example, a computer that creates scan data and a computer that displays a form image and an image cursor 204 and performs processing for receiving input of a character string may be different computers. Further, the input support system 10 is configured by the client and the server, and one image data obtained by combining the view 202 of the form image and the image cursor 204 is created on the server side, and the Web page including the image data and the input field 203 May be generated by HTML (HyperText Markup Language) and displayed on the client side.

  In this embodiment, an image obtained by reading a form is displayed. However, the present invention is not limited to a form, and any image may be used as long as an image in which a character string is entered is read.

  In the present embodiment, the image is read by the scanner. However, the present invention is not limited to the scanner, and scan data may be created by taking an image with a digital camera, for example.

  In the present embodiment, the image cursor display unit 113 creates a transparent cursor panel and draws the image cursor 204 as a rectangular figure on the cursor panel. What is necessary is just to make it distinguishable from these areas. For example, the image cursor display unit 113 may draw a rectangle directly on the form image, or draw a rectangle filled with the cursor area on the cursor panel so that the form image can be seen through. Good. Further, the color obtained by performing the arithmetic processing on the pixels included in the cursor area of the form image may be changed. Alternatively, the image in the cursor area may be enlarged and displayed superimposed on the form image. In addition, the form image is divided into a rectangle of the cursor area, a rectangle adjacent to the upper, lower, left, and right of the cursor area, and an upper left, upper right, lower right, and lower left rectangle of the cursor area sandwiched between the upper, lower, left, and right rectangles. The view 202 of the form image may be displayed so as to provide a gap between these rectangles.

  In this embodiment, when the entire cursor area is not included in the view area, scroll processing is performed to change the view area so that the upper left corner of the cursor area matches the upper left corner of the view area. However, when a part of the cursor area is included in the view area, the scroll process may not be performed. In this embodiment, the scroll process is performed so that the coordinates of the upper left corner of the view area become (CX, CY) in step S3305 in FIG. 11, but the right end X coordinate of the view area is the form image. When the right edge X coordinate of the view area is exceeded, the X coordinate value of the upper left corner of the view area is the value obtained by subtracting the width VW of the view area from the right edge X coordinate value of the view area, and the lower end Y coordinate of the view area is the lower end of the form image. When the Y coordinate is exceeded, the scroll processing may be performed so that the Y coordinate value of the upper left corner of the view area is a value obtained by subtracting the height VH of the view area from the lower end Y coordinate value of the view area. .

  Further, instead of aligning the upper left corner of the view area with the cursor area, the view area may be moved while maintaining the positional relationship between the view area and the cursor area. In this case, before step S3303 in FIG. 11, the difference between CX and VX (CX−VX) and the difference between CY and VY (CY−VX) are calculated as (DX, DY), and the focus is adjusted in step S3303. After reading X, Y, W, and H of the cursor definition information corresponding to the acquired input field 203, steps S3304 to S3306 are omitted, and coordinates obtained by subtracting DX and DY from CX and CY (CX-DX, CY). -DY) can be scrolled. Accordingly, the image cursor 204 corresponding to the focus can be displayed while fixing the position of the relative cursor area in the view area.

  In the present embodiment, the form image display unit 112 and the image cursor display unit 113 are only described as being realized by the CPU 101 executing a program stored in the storage device 103. Is described in an object-oriented programming language such as Java (registered trademark), the form image display unit 112 is implemented as a first class generally provided for image drawing processing, The image cursor display unit 113 can be implemented as a second class that inherits the first class. In this case, it has been implemented in the first class by creating a second class that includes a method to display the graphic showing the cursor area on the image by inheriting the first class that is generally provided Since only the method for displaying the graphic indicating the cursor area needs to be developed while using the method related to image processing, development efficiency can be improved.

  In the present embodiment, it is assumed that the character string displayed in the form image is input by the operator into the input field 203 with the keyboard. However, for each piece of cursor definition information, the character string area information included in the cursor definition information Extract and analyze a partial image of the cursor area specified by, perform OCR (Optical Character Reader) processing to detect the character string entered in the cursor area, and handle the detected character string An OCR processing unit for inputting in the input field 203 may be provided. Note that a general character string recognition process can be adopted for the OCR process. In this case, the input by the input person can be omitted for character strings that can be recognized by OCR. Therefore, the input efficiency of the character string can be further improved. Moreover, since the operator can put effort into the confirmation work of input contents, such as correcting a recognition error, reduction of input mistakes is expected.

  Further, in this embodiment, it is assumed that the scan data are all in the same format and the same input item is in the same cursor area, but the cursor area may be managed for each type of form. In this case, the cursor definition storage unit 132 stores cursor definition information for each type of form. The form image display unit 112 receives an input of the form type from the operator when reading the scan data. The image cursor display unit 113 reads cursor definition information corresponding to the input type. As a result, the image cursor 204 can be displayed for various types of forms. In this case, the position and shape of the image cursor 204 can be adjusted according to the form of the form. Therefore, even when input is performed while referring to data in various formats, it is possible to input efficiently.

  An image in which the form type (category) is encoded by a bar code or QR code (registered trademark) is displayed on the form, and the scan data registration unit 111 recognizes and recognizes the encoded type. The scan data may be registered in the scan data storage unit 131 in association with the type. Further, the form type may be printed on the form by a character string, a number, a symbol, or the like and recognized. In this case, the position and size of the image cursor 204 can be changed by recognizing the type printed on the form. Therefore, if the type is printed on the form, the image cursor 204 can be drawn immediately after the form is read by the scanner after the characters are entered. For example, a window service that accepts forms related to a plurality of services. Therefore, it is possible to improve the efficiency of character string input processing.

  Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention can be changed and improved without departing from the gist thereof, and the present invention includes equivalents thereof.

DESCRIPTION OF SYMBOLS 10 Input support system 111 Scan data registration part 112 Form image display part 113 Image cursor display part 114 Image operation instruction input part 115 Data input part 131 Scan data memory | storage part 132 Cursor definition memory | storage part 133 Input data memory | storage part 20 Screen 201 Display column 202 View 203 Input field 204 Image cursor 205 Enlarge button 206 Reduce button 207 Left rotate button 208 Right rotate button 209 Horizontal scroll bar 210 Vertical scroll bar 211 End button

  A main invention of the present invention for solving the above problems is a display device, an image data storage unit for storing image data for displaying an image, and information to be displayed is drawn on the image An information area information storage unit that stores information area information for specifying an information area that is an area, an image display unit that displays the image on a screen, and an image operation including enlargement, reduction, rotation, and movement of the image And an image cursor display unit that displays the information area in a distinguishable manner from other areas in accordance with the image operation.

The display device of the present invention may further include an information reading processing unit that recognizes the information described in the information area specified by the information area information by an optical information reading process.
According to another aspect of the present invention, there is provided a display device that includes an image data storage unit that stores image data for displaying an image, and information that is an area in which information to be displayed is drawn on the image. An information area information storage unit for storing information area information for specifying an area; an image display unit for displaying the image on a screen; and the information described in the information area specified by the information area information. And an information reading processing unit that is recognized by optical information reading processing.
In this case, the input by the input person can be omitted for the character string that can be recognized by the optical information reading process. Therefore, the input efficiency can be further improved. Moreover, since the input person can put effort into the confirmation work of input contents, such as correcting a recognition error, a reduction in input mistakes is expected.

Another aspect of the present invention is a program, an image data storage unit that stores image data for displaying an image, and an information area in which information to be displayed is drawn on the image An information area information storage unit for storing information area information for identifying the image, a step of displaying the image on a screen, and an instruction for image operation including enlargement, reduction, rotation, and movement of the image And the step of displaying the information area so as to be distinguishable from other areas in accordance with the image operation.
Another aspect of the present invention is a program, an image data storage unit that stores image data for displaying an image, and an information area in which information to be displayed is drawn on the image An information area information storage unit for storing information area information for identifying the information area, a step of displaying the image on a screen, and the information area specified by the information area information And a step of recognizing information by an optical information reading process.

Claims (12)

A device that supports input of a character string drawn in an image,
An image data storage unit for storing image data for displaying the image;
A character string area information storage unit for storing character string area information for specifying a character string area on which the character string to be input is drawn on the image;
An image display unit that displays a partial image included in a view area that is a partial area displayed on the screen among the images;
An image cursor display unit for displaying the character string area specified by the character string area information so as to be distinguishable from other areas;
With
The image display unit changes the view area so that the character string area is included in the view area when the view area does not include the character string area, and is included in the changed view area. Displaying the partial image;
An input support device characterized by the above. The input support apparatus according to claim 1,
An input field display unit for displaying a plurality of input fields for inputting the character string on the screen;
A focus detection unit that detects that the input field has acquired focus;
Further comprising
The character string area information storage unit stores, for each input field, the character string area information for specifying the character string area in which the character string to be input to the input field is drawn,
The image cursor display unit reads the character string region information corresponding to the input field that has acquired the focus from the character string region information storage unit, and reads the character string region specified by the read character string region information. Displaying distinguishably from the other areas,
An input support device characterized by the above. The input support device according to claim 2,
The image display unit, when the first character string area specified by the first character string area information corresponding to the first input field that has acquired the focus is not included in the view area, Calculating an offset from the second character string region specified by the second character string region information corresponding to the second input field that has lost the focus to the first character string region; Changing the position of the view area according to
An input support device characterized by the above. The input support apparatus according to any one of claims 1 to 3,
The character string area is a rectangle, and the character string area information includes a coordinate value indicating a reference point of the rectangle, and a width and a height of the rectangle;
An input support device characterized by the above. The input support apparatus according to any one of claims 1 to 4,
An image operation instruction input unit that receives an instruction of image operation including enlargement, reduction, rotation, and movement of the image;
The image display unit applies the image operation to the image data, extracts and displays the partial image included in the view area from an image based on the image data to which the image operation is applied,
The image cursor display unit displays the character string area so as to be distinguishable from the other areas according to the image operation;
An input support device characterized by the above. The input support apparatus according to any one of claims 1 to 5,
The image cursor display unit creates a transparent panel overlapping the partial image, and draws a graphic indicating the character string area on the created transparent panel;
An input support device characterized by the above. The input support apparatus according to any one of claims 1 to 6,
The image display unit is realized by executing a program defined by a first class of an object-oriented programming language,
The image cursor display unit is realized by executing a program defined by a second class that inherits the first class;
An input support device characterized by the above. The input support apparatus according to any one of claims 1 to 7,
A character recognition processing unit for recognizing the character string described in the character string region specified by the character string region information by OCR processing;
An input support device characterized by the above. The input support apparatus according to any one of claims 1 to 8,
The image data storage unit stores the category of the image in association with the image data,
The character string area information storage unit stores the character string area information in association with the category,
An image designating unit that accepts designation of the image data;
The image display unit extracts and displays the partial image included in the view area from the image based on the designated image data;
The image cursor display unit reads the category corresponding to the designated image data from the image data storage unit, reads the character string region information corresponding to the read category from the character string region information storage unit, Displaying the character string area specified by the read character string area information in a distinguishable manner from the other areas;
An input support device characterized by the above. The input support device according to claim 9,
Connected to a scanner that reads the form printed with the category and outputs the image data;
An image analysis unit that analyzes the image data captured from the scanner and determines the category;
An image registration unit that registers the image data in the image data storage unit in association with the category determined by the image analysis unit;
An input support apparatus, further comprising: A method for supporting input of a character string drawn in an image,
Storing image data for displaying the image;
Storing character string area information for specifying a character string area on which the character string to be input is drawn on the image;
Displaying a partial image included in a view area which is a partial area displayed on the screen among the images;
Displaying the character string area specified by the character string area information in a distinguishable manner from other areas;
With
The step of displaying the partial image includes changing the view area so that the character string area is included in the view area when the character area is not included in the view area, and the changed view area Displaying the partial image included in
An input support method characterized by the above. A program for supporting input of a character string drawn on an image,
On the computer,
Storing image data for displaying the image;
Storing character string area information for specifying a character string area on which the character string to be input is drawn on the image;
Displaying a partial image included in a view area which is a partial area displayed on the screen among the images;
Displaying the character string area specified by the character string area information in a distinguishable manner from other areas;
And execute
In the step of displaying the partial image, when the character string area is not included in the view area, the view area is changed so that the character string area is included in the view area in the computer, A program for further executing a step of displaying the partial image included in the changed view area.

Images