JP2008083988A - Input form creation apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an input form creation apparatus for successively entering characters in rectangular areas of a form, photographing the form and automatically creating an input form to which an input condition such as the entering order of characters into the rectangular areas is reflected. <P>SOLUTION: The input form creation apparatus 1 photographs a form S having a plurality of rectangular areas by a camera 11, acquiring the image data of the form, detects the outline of the form S and the positions of the rectangular areas on the basis of the acquired image data, photographs and acquires the image data of the entered form by the camera 11 in each user's entry of characters in a rectangular area to be input next in the form S, calculates a difference between the newly acquired image data and image data acquired in the preceding time, detects the position of a rectangular area in which characters are newly entered on the basis of the calculated difference, and stores the detected order correspondingly to the rectangular areas. Then an input form in which the order of entering characters in respective rectangular areas by the user is reflected to the input order is created on the basis of the order stored correspondingly to respective rectangular areas. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an input form creation device and a program for creating a Web input form.

  Conventionally, as a technique for automatically creating an input form for a user to perform an operation input from a Web browser or the like, for example, Patent Document 1 discloses a structure definition file for information created in advance and a display name definition file for information elements. In addition, based on the analyzed information, there is described an input form automatic creation device that automatically displays on a client terminal a GUI for registering, updating, referring to, and deleting information managed by a back-end system.

Patent Document 2 describes a form reading device that forms optical image information by placing a form on a table and capturing an image of a two-dimensional area including the form placed on the table.
JP 2003-99255 A Japanese Patent Laying-Open No. 2005-2060

  However, in Patent Document 1, a structure definition file for automatically creating an input form is required in advance, and a structure definition file must be created in advance from a paper form when migrating from a paper form. There is a problem that it takes time and effort and requires specialized knowledge.

  Further, when creating an input form from a paper form, it is conceivable to read the paper form with a form reading apparatus such as Patent Document 2 and display the read form on the screen as an input form. When input is performed, input conditions such as the input order for multiple input items, the input character size for each input item, and the maximum number of characters are often determined. Conventionally, such input conditions are reflected in the input form. In order to do this, it is necessary to manually set the input conditions for each input item according to the description language of the input form.

  An object of the present invention is to automatically create an input form reflecting input conditions such as the order in which characters are entered in the rectangular area from the image data obtained by sequentially writing characters in the rectangular area of the form. Is to do so.

  The present invention captures a form having a plurality of rectangular areas, obtains image data of the form, and outlines and rectangular areas of the form based on the image data of the form photographed by the photographing means. A rectangular area detecting means for detecting the position of the rectangular area; a storage means for storing information on the position of each rectangular area detected by the rectangular area detecting means; and a user entering characters in one rectangular area of the form. When the form filled in is photographed by the photographing means, every time the filled form is photographed by the photographing means, the image data newly obtained by the photographing means and the previous acquisition by the photographing means are taken. An input area detecting means for calculating a difference from the image data and detecting a position of a rectangular area in which a character is newly written based on the calculated difference; and the input area The counting means for counting the order in which the position of the rectangular area is detected in the output means, the image data of the form acquired by the photographing means, the position of the rectangular area detected by the input area detecting means, and the rectangular area And creating means for creating an input form that reflects the order in which the user entered the rectangular area of the form in the input order based on the detected order.

  According to the present invention, it is possible to automatically create an input form that reflects input conditions such as the order in which characters are entered in the rectangular area simply by the user sequentially writing characters in the rectangular area of the form and taking a picture. It is possible to improve the convenience when creating the input form.

Hereinafter, embodiments of the present invention will be described.
First, the configuration will be described.
FIG. 1 is a diagram showing an overall configuration of a form input system 100 to which an input form creation apparatus 1 according to the present invention is applied. As shown in FIG. 1, a form input system 100 is a client in which an input form creation device 1 for creating a web input form and a web server 2 are connected so that data can be transmitted and received, and a web server 2 and a web browser are installed. The terminal 3 is configured to be connected via a communication network N such as a LAN (Local Area Network), a WAN (Wide Area Network), and the Internet.

  In the form input system 100, the input form data created by the input form creation device 1 is stored in the Web server 2. The web server 2 displays various web screens including the input form created by the input form creation device 1 on the display screen of the client terminal 3 in response to a request from the web browser mounted on the client terminal 3. To do.

Hereinafter, the configuration of the input form creation device 1 will be described in detail.
FIG. 2 is a block diagram showing a functional configuration of the input form creation apparatus 1. As shown in FIG. 2, the input form creation device 1 includes a camera 11, a memory 12, an image processing device 13, an analysis information memory 14, an input form automatic creation device 15, a creation result storage device 16, a control device 17, and a program storage device. 18, an input order counter 19, a communication I / F 20, an operation unit 21, and the like, and each unit is connected via a bus.

  As shown in FIG. 3, the camera 11 as an imaging unit is provided at a thin plate-like mounting table 11a for mounting the form S, an arm 11b provided on the mounting table 11a, and a tip of the arm 11b. And a digital camera 11d that is mounted on the mounting portion 11c and photographs the form S mounted on the mounting table 11a. The digital camera 11d includes an imaging lens, a CCD (Charge Coupled Device), an A / D converter, an imaging control unit, and the like. The digital camera 11d photoelectrically converts subject light imaged through the imaging lens by the CCD, The photoelectrically converted analog signal is converted into a digital signal by an A / D converter to obtain image data.

  Here, the form S is a form having a plurality of rectangular areas (hereinafter referred to as rectangular areas), and characters are entered (input) for items to be entered (input) in the plurality of rectangular areas. Input areas (hereinafter referred to as input areas).

  The memory 12 temporarily stores image data captured by the camera 11 based on control by the control device 17. As shown in FIG. 4A, the memory 12 includes a form image area 121 for storing image data obtained by photographing a form S that has not been filled in by the camera 11 in an input form creation process to be described later. In the input form creation process, in the latest image area 122 for storing image data obtained by newly taking a picture of characters entered in the input area of the form S, and in the latest image area 122 in the input form creation process. The stored image data has a previous image area 123 for storing image data obtained by photographing one time before photographing of the image.

  The image processing device 13 is configured by a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and by software processing by cooperation between the CPU and a program stored in the ROM, A form outline and rectangular area detection process, an input area detection process, and a character size / character number detection process, which will be described later, are executed.

  The analysis information memory 14 is a memory for storing the processing result in the image processing device 13 and is detected by the image processing device 13 in association with the identification number of each rectangular area as shown in FIG. In addition, the area detection result area 141 (see FIG. 7D; storage means) for storing the position information of each rectangular area and the identification number of each rectangular area are detected in association with the identification number of each rectangular area. It has an input detection result area 142 (see FIG. 13) for storing the input order, character size, and number of characters of the rectangular area.

  The input form automatic creation device 15 is constituted by a CPU, a ROM, a RAM, and the like, and by a software process in cooperation with the CPU and a program stored in the ROM, a web input form HTML automatic creation process, style sheet automatic, which will be described later, is performed. A creation process is executed, and an input form is automatically created based on the analysis information stored in the analysis information memory 14.

  The creation result storage device 16 is a memory for storing the creation result data of the input form in the input form automatic creation device 15.

  The control device 17 is configured by a CPU, a RAM, and the like, and controls each unit according to a program stored in the program storage device 18 to execute an input form creation process to be described later.

  The program storage device 18 is constituted by a ROM, and stores a program, data, and the like for controlling the input form creation device 1.

  The input order counter 19 is a counter that stores the input order n.

  The communication I / F 20 is a communication interface that connects the input form creation device 1 to the Web server 2 and performs data transmission / reception with the Web server 2.

  The operation unit 21 includes a start key for inputting an input form creation instruction, an end key for inputting a series of shooting end instructions for creating the input form, a shutter key for instructing shooting by the camera 11, and the like. (Both not shown), and outputs an operation signal corresponding to each key operation by the user to the control device 17.

Next, the operation of the present embodiment will be described.
FIG. 5 is a flowchart showing an input form creation process executed by the control device 17. This process is a process executed by the control device 17 when the start key of the operation unit 21 is pressed.

  First, the digital camera 11 d of the camera 11 is controlled in response to the pressing of the shutter key of the operation unit 21, the form S placed on the placing table 11 a is photographed, and the photographed image data is the form image area 121 of the memory 12. (Step A1).

  Next, in the image processing device 13, a form outline and rectangular area detection process is performed (step A 2), and the identification number and position information of the detected rectangular area are associated with each other in the area detection result area 141 of the analysis information memory 14. Registered (step A3), the process proceeds to step A4.

  FIG. 6 is a flowchart showing a form outline and rectangular area detection process executed in the image processing apparatus 13 in step A2. By executing this processing, a rectangular area detecting unit is realized.

  In the form outline and rectangular area detection process, first, the captured image data stored in the form image area 121 is read out, and straight line detection is performed on the read captured image data, and the detected straight line is formed. Out of the rectangular areas closed to the quadrangle, the outermost rectangular area is detected as the outline of the form S (step A101). For the straight line detection, for example, a known Hough transform or the like can be used.

  Next, angle correction is performed to correct the inclination of the image area surrounded by the contour detected from the photographed image data, that is, the image area of the form S, and the image data after the angle correction is cut out to obtain the image data of the form S. (Form image data) is created, and the created form image data is stored in the form image area 121 and the previous image area 123 of the memory 12 (step A102). In the angle correction, one side of the image region surrounded by the detected contour is set as a reference (for example, l1 in FIG. 7A), and the one side (or an extension line) serving as the reference is photographed. An inclination angle θ with respect to a corresponding side of the image data (for example, l2 in FIG. 7A) is calculated, and the captured image data is rotated by an angle −θ. Then, an image region surrounded by the detected contour is cut out from the photographed image data that has been subjected to the rotation processing, and form image data is created.

  Next, straight line detection is performed on the form image data, a plurality of rectangular areas surrounded by the detected four straight lines, that is, rectangular areas are detected, and an identification number is assigned to each of the detected rectangular areas. Thus, position information of each rectangular area (upper left coordinate information and lower right coordinate information of the rectangular area) is acquired (step A103). Then, the information (identification number and position information) of each detected rectangular area is output to the control device 17 (step A104), and the detected identification number and position information of each detected rectangular area is analyzed in step A3 of FIG. It is registered in the area detection result area 141 of the information memory 14.

 FIG. 7A shows an example of photographed image data obtained by photographing the form S. For the photographed image data shown in FIG. 7 (a), the outline of the form S is detected in the outline and rectangular area detection processing of the form, and the image area of the form S surrounded by the detected outline is angle-corrected. By cutting out from the captured image data, the form image data shown in FIG. 7B is acquired. Next, straight line detection is performed from the form image data, and each rectangular area (rectangular area) surrounded by the four detected straight lines is detected. As shown in FIG. 7C, each detected rectangular area is detected. An identification number is given. Then, the identification number of each rectangular area and the position information (upper left coordinate information and lower right coordinate information of the rectangular area) are associated with each other and registered in the area detection result area 141 of the analysis information memory 14. FIG. 7D shows an example of rectangular area information registered in the area detection result area 141.

  In step A4 of FIG. 5, the input order n = 1 is set in the input order counter 19 (step A4), and then it is determined whether or not the end key of the operation unit 21 is pressed (step A5). If it is determined that the end key has not been pressed (step A5; NO), a shooting standby state is entered. By the user, in the rectangular area of the form S, in the input area to be input in the nth input order on the input form, the characters corresponding to the maximum number of characters that can be input in the area are entered in characters of the size to be input ( When n = 2 or later, a form S that has been added to the previously taken form S) is placed on the placement table 11a, and when the shutter key of the operation unit 21 is pressed, the camera 11 is controlled in response to the press of the shutter key. The digital camera 11d shoots the completed form S placed on the placement table 11a, and the obtained photographed image data is stored in the latest image area 122 of the memory 12 (step A6).

  Next, in the image processing device 13, input area detection processing (step A7) and character size / number of characters detection processing are performed (step A8), and associated with the identification number of the rectangular area detected in the input area detection processing, The input order, character size, and number of characters are registered in the input detection result area 142 of the analysis information memory 14 (step A9), and the process proceeds to step A10.

FIG. 8 is a flowchart showing the input area detection process executed in the image processing apparatus 13 in step A7. By executing the processing, an input area detecting unit is realized.
In the input area detection process, first, the photographed image data stored in the latest image area 122 (the photographed image data newly photographed this time) is read, and straight line detection is performed on the read photographed image data. The outermost rectangular area is detected as the outline of the form S among the areas (rectangular areas) closed to the quadrangle formed of the detected straight lines, and the image data of the image area of the form S surrounded by the detected outline Are cut out with the angle corrected, and the cut-out image data is overwritten and stored in the latest image area 122 of the memory 12 (step A201).

  Next, the image signal value of each pixel of the image data stored in the previous image area 123 that was previously captured and the area of the form S is cut out, and the current image captured in the latest image area 122 and the form are stored. A difference from the pixel signal value of each corresponding pixel in the image data from which the area S is cut out is calculated, and difference image data is created and temporarily stored in the RAM (step A202). In order to accurately reflect the difference between the image data captured last time and the image data captured this time in the difference image data, it is preferable to perform correction to align both colors and brightness.

 FIG. 9A shows an example of captured image data obtained by capturing a form S by entering characters in a rectangular area to be input first. In step A201, the outline detection of the form S is performed on the photographed image data shown in FIG. 9A, and the image area of the form S surrounded by the detected outline is angle-corrected and cut out from the photographed image data. As a result, the image data shown in FIG. 9B is acquired. Then, the difference between the image signal value of each pixel of the image data of the form S taken last time shown in FIG. 9C and the image signal value of each corresponding pixel of the image data of the form S taken this time is calculated. As a result, the difference image data shown in FIG. 9D is created.

When the difference image data is created, difference analysis processing is executed (step A203).
FIG. 10 is a flowchart showing the difference analysis process executed by the image processing apparatus 13 in step A203 of FIG.

  First, a pixel counter 131 is formed in the RAM of the image processing apparatus 13 for storing a count value (initial value is 0) of pixels (pixels) whose absolute value of the difference is equal to or greater than a threshold value for each rectangular area (see FIG. Step A2031). Next, each piece of pixel data (hereinafter referred to as pixel data) constituting the difference image data is extracted as a processing target one by one (step A2032), and the absolute value of the value (difference value) of the extracted pixel data is greater than or equal to the threshold value. Is determined (step A2033). If it is determined that the absolute value of the difference value of the extracted pixel data is not greater than or equal to the threshold (step A2033; NO), the process proceeds to step A2035. On the other hand, if it is determined that the absolute value of the difference value of the extracted pixel data is greater than or equal to the threshold (step A2033; YES), the pixel counter 131 corresponds to the rectangular area where the pixel data extracted in step A2032 exists. The count value to be counted is incremented by 1 (step A2034), and the process proceeds to step A2035.

  In step A2035, it is determined whether or not there is pixel data to be processed next. If it is determined that there is pixel data to be processed next (step A2035; YES), the next processing object is processed. Is extracted (step A2036), and the process returns to step A2033. When the processing is completed for all the pixel data constituting the difference image data and it is determined that there is no pixel data to be processed next (A2035; NO), the processing proceeds to step A204 in FIG. .

  FIG. 11 is a diagram illustrating an example of the pixel counter 131 after the difference analysis processing. As shown in FIG. 11, the pixel counter 131 stores the total result of pixels (pixels) that exist in the area and whose absolute value of the difference image data is greater than or equal to the threshold value in association with the identification number of each rectangular area. ing.

  In step A204 of FIG. 8, the pixel counter 131 is referred to, and the rectangular area having the largest count value is entered in the user as an area to be input in the nth input order (input in the nth input order). The identification number of the determined rectangular area is output to the control device 17. In the control device 17, the determination result output from the image processing device 13 is temporarily stored in the RAM of the control device 17. And a process transfers to step A8 of FIG.

FIG. 12 is a flowchart showing the character size / character number detection process executed in the image processing apparatus 13 in step A8 of FIG. By executing this processing, a character size detecting unit and a character number detecting unit are realized.
In the character size / character number detection process, first, a character number counter is formed in the RAM, and character number counter = 0 is stored (step A301). Next, in step A204 of FIG. 8, a character area is cut out from the rectangular area determined as the input area (step A302). For example, as in a known character recognition engine, the character region segmentation process is performed by sequentially scanning in the digit (X) coordinate direction for each row (Y) coordinate in the target area. A row range having black dot pixels (colored pixels different from the background) is detected, and scanning is sequentially performed in the row (Y) coordinate direction for each digit (X) coordinate, and there is a black dot pixel in the target area. A digit range is detected, a circumscribed rectangle of a character included in the target area is created based on the detected line range and digit range, and the circumscribed rectangle is cut out as a character region.

  Next, the number of character areas cut out is counted, the count value is stored in the character number counter (step A303), and the character size in the area is determined based on the size of each cut out character area (step A303). A304). For example, the number of pixels (number of pixels) in each cutout character area is counted, an average value of the number of pixels in each character area is calculated, and the calculated average value is determined as the character size. Then, the value of the character counter is set as the number of characters, and the character size value determined in step A304 is output as the character size to the control device 17 (step A305), and the process proceeds to step A9 in FIG.

  In step A9 of FIG. 5, the character size and the number of characters output from the image processing apparatus 13 in step A8 are analyzed in association with the identification number of the rectangular area output from the image processing apparatus 13 in step A7. It is registered in the input detection result area 142 of the information memory 14. FIG. 13 shows a data storage example of the input detection result area 142.

  In step A10 of FIG. 5, n stored in the input order counter 19 is incremented by 1 (counting means), and the previous image area 123 is overwritten by the image data stored in the latest image area 122. Return to Step A5. When a user adds a character to the rectangular area to be input next and the shutter key is pressed, shooting is performed, and as described above, the input area detection process and the character size / character number detection process are performed. Determination, character size, and number of characters are detected. That is, as shown in FIG. 14, every time a user enters (adds) a character in a rectangular area (input area) to be input next to the form S, the entered form S is photographed, and the input area is determined. , Character size and number of characters are detected.

  When characters are entered in all rectangular areas to which characters are to be input and the process is completed and the end key of the operation unit 21 is pressed (step A5; YES), based on the information registered in the analysis information memory 14 Then, the Web input form is automatically created in the input form automatic creation device 15 (step A11).

  In the input form automatic creation device 15, the web input form is automatically created by executing the web input form HTML automatic creation process and the style sheet automatic creation process. That is, the creation means is realized by executing the Web input form HTML automatic creation processing and the style sheet automatic creation processing.

  FIG. 15 is a flowchart showing a Web input form HTML automatic creation process. FIG. 16 is a flowchart showing style sheet automatic creation processing. FIG. 17 is a diagram showing the contents of HTML (HyperText Markup Language) created by the Web input form HTML automatic creation process. FIG. 18 is a diagram showing the contents of the style sheet created by the style sheet automatic creation process.

  In the Web input form HTML automatic creation process, first, HTML of a standard part related to items other than the input form and the background image is created on the RAM (step A401). Here, in HTML, HTML description is performed between <html> and </ html>, and the header of the entire HTML document (related to a Web page described in HTML) is performed between <head> and </ head>. Information) is described in <body> to </ body> as content to be displayed on the Web browser. Therefore, first, a description is given of parts other than the input form and the background image (G1 and G5 in FIG. 17) as contents to be displayed on the Web browser, that is, parts not reflected in the contents to be displayed on the browser. This part is a stylized description, which is sequentially described by software processing. The “href =” of the link tag in G1 in FIG. 17 contains a style sheet file created by the style sheet automatic creation processing. The name is inserted. The file name of the style sheet is mechanically given as “form + serial number.css”.

  Next, a resizing ratio is calculated for resizing the form image data (image data stored in the form image area 121) obtained by photographing the unfilled form S by photographing to the screen display size (target display size). (Step A402). The resizing ratio is calculated by “resizing ratio = horizontal width of target display size ÷ horizontal width of image size of form image data”. For example, when the image size of the form image data is 4680 pixels × 3640 pixels and the target display size is 468 pixels × 364 pixels, the resizing ratio is 1/10.

  Next, the form image data is resized at the calculated resizing ratio, and the resized image data is automatically stored with a file name in the RAM in the input form automatic creating apparatus 15 (step A403).

  Next, a description for displaying the image file of the resized image data on the browser is additionally written in the HTML created in step A401 (step A404). G2 in FIG. 17 is a description added in step A404, and is additionally written by software processing. In “src =”, the file name of the resized image data (file name given in step A403) Is inserted.

  Next, the input detection result area 142 (see FIG. 13) of the analysis information memory 14 is referred to, and based on the contents registered in the input detection result area 142, the description about the input form is added to the HTML added in step A404. Are additionally written (step A405). G3 in FIG. 17 is a description of the input form added in step A405. The description about the input form is a description of the contents for creating the parts constituting the input form (here, the input area to be arranged on the input form). First, the contents for creating the input area reflecting the detection result related to the rectangular area of the input order 1 registered in the input detection result area 142 are described, and then the input order is 2, 3,... Describes the contents for creating the input area. For example, when the information shown in FIG. 13 is registered in the input detection result area 142, an input area reflecting the contents related to the area 8, an input area reflecting the contents related to the area 5, and an input area reflecting the contents related to the area 11 are displayed. The contents to be created are described sequentially.

  The description of the input form is additionally written by software processing, but “class =” indicating the name of the class of the input area to be created is the name of the class created for the input area in the style sheet (here, area + the identification number of the rectangular area to be reflected in the input area) is inserted. In “size =” indicating the character size of the input area to be created, the character size associated with the identification number of the rectangular area to be reflected in the input area in the input detection result area 142 is the resize calculated in step A402. The character size reduced by the ratio is written. In “name =” indicating the name of the input area to be created, the name of the corresponding input area (here, inpt + input order) is inserted. In “tabindex =” indicating the cursor movement order by the tab key, a number indicating the input order associated with the identification number of the rectangular area to be reflected in the input area in the input detection result area 142 is inserted. In “cols =” indicating the maximum number of characters that can be input in the input area to be created (maximum number of input characters), the number of characters associated with the identification number of the rectangular area to be reflected in the input area in the input detection result area 142 Is inserted. In “onKeyUp =” that indicates the destination of the cursor when the maximum number of input characters in the input area is reached, the maximum number of input characters in the input area and the name of the input area corresponding to the next input order are inserted at a predetermined position. Is done.

  When the additional writing for the input form is completed, a description for creating a send button (G4 in FIG. 17) is additionally written (step A406). When the additional writing for the send button is completed, the HTML creation result is output to the control device 17 (step A407), the process is terminated, and the style sheet automatic creation process is executed.

Hereinafter, the style sheet automatic creation processing will be described with reference to FIG.
First, a counter m is formed in the RAM, and m = 1 is set (step A501). Next, the input detection result area 142 (see FIG. 13) of the analysis information memory 14 is referred to, and has a class for the input area of the input order m (here, area + class name of the identification number of the rectangular area to be reflected in the input area). Class) is created (step A502).

  Next, items other than top, left, width, and font-size are added to the created class (step A503). Here, as shown in FIG. 18, items of border-style, background-color, display, z-index, position, and overflow are added by software processing. The contents of each item are predetermined.

  Next, from the area detection result area 141 of the analysis information memory 14, the coordinate information of the rectangular area associated with the input order m in the input detection result area 142 (area upper left coordinates (X, Y), area lower right coordinates (X , Y)) is read out, and the character size corresponding to the input order m is read out from the input detection result area 142 (step A504), and the top, left, and left sides are read based on the read coordinate information and character size. , Width, and font-size parameters are calculated (step A505).

FIG. 19 is a flowchart showing in detail the process of step A505.
First, by calculating the absolute value of the difference between the read upper left X coordinate and lower right X coordinate, the value of width before resizing is calculated (step A5051). Next, the value of width is calculated by multiplying the image resizing ratio by the value of width before resizing, and the calculation result is stored in the RAM in association with the identification number of the rectangular area corresponding to the input order m ( Step A5052).

  Next, the resize ratio of the image is multiplied by the value of the upper left X coordinate, and the value of left is calculated by adding the number of blank pixels from the left end surface of the area (for example, 16) to the obtained value. The calculation result is stored in the RAM in association with the identification number of the rectangular area corresponding to the input order m (step A5053). Next, the resize ratio of the image is multiplied by the value of the upper left Y coordinate, and the value of top is calculated by adding the number of pixels (for example, 16) for the margin from the upper end surface of the area to the obtained value. The calculation result is stored in the RAM in association with the identification number of the rectangular area corresponding to the input order m (step A5054).

  Next, the resize ratio of the image is multiplied by the read character size to calculate the font-size value, and the calculation result is stored in the RAM in association with the identification number of the rectangular area corresponding to the input order m. (Step A5055). Then, the process proceeds to step A506 in FIG.

  20 is calculated based on the data stored in the area detection result area 141 shown in FIG. 7D, the data stored in the input detection result area 142 shown in FIG. 13, and the resizing ratio 1/10. The calculation results of top, left, width, and font-size for each area are shown.

  In step A506 in FIG. 16, the top, left, width, and font-size are added to the class created in step A502 based on the values of the top, left, width, and font-size parameters calculated in step A505. Each item is additionally written. Then, it is determined whether or not classes for all input areas have been created. If it is determined that classes have not yet been created (step A507; NO), the counter m is incremented by 1 (step A508), Return to Step A502. If it is determined that classes for all input areas have been created (step A507; YES), the created style sheets are output to the control device 17, and the process ends.

  Returning to FIG. 5, when the automatic creation of the Web input form in the input form automatic creation device 15 is completed, the created Web input form, that is, the HTML and style sheet data, and the resized form image data file are created. The data is stored in the storage device 16 (step A12) and transmitted to the Web server 2 via the communication I / F 20 (step A13). Then, the RAM, memory, and analysis information memory of each device used are released (step A14), and this process ends.

  The created input form data is stored in the Web server 2 and displayed on the display screen of the client terminal 3 in response to a request from the client terminal 3. The input form displayed on the client terminal 3 performs the operation shown in FIG. 21 based on the description of the HTML and style sheet of the Web input form created by the input form creation process by the Web browser. The operation of the input form displayed on the client terminal 3 will be described below with reference to FIG.

  When the cursor is placed at the first input position in the first input area (step B1) and one character is input (step B2; YES), the input character is displayed in the character size specified in HTML. (Step B3). Next, it is determined whether or not the maximum number of characters that can be input is input in the input area. If it is determined that the maximum number of characters has not yet been input (step B4; NO), the input area The cursor is moved to the next input position (step B5). Next, it is determined whether or not the tab key has been pressed. If it is determined that the tab key has not been pressed (step B6; NO), the process returns to step B2 to wait for the next character to be input. If it is determined that the tab key has been pressed (step B6; YES), the cursor is moved to the first input position in the input area of the next input order (step B7), and the process returns to step B2.

  On the other hand, if it is determined in step B4 that the maximum number of characters that can be input is input in the input area (step B4; YES), it is determined whether there is an input area in the next input order, and the next input order is determined. If it is determined that there is an input area (step B8; YES), the cursor is moved to the input area at the first input position in the next input order (step B9), and the process returns to step B2. When it is determined that there is no input area in the next input order (step B8; NO), the transmission button is waited to be pressed, and when the transmission button is pressed (step B10; YES), input is performed from the displayed input form. The transmitted information is transmitted to the Web server 2 (step B11), and this process ends.

  FIG. 22 shows an example of an input form displayed on the client terminal 3. The input form in FIG. 22 is an input form displayed by the HTML shown in FIG. 17 and the style sheet shown in FIG. In FIG. 22, when two characters are input in the input area of the first input order (center area of the third stage), the cursor automatically moves to the second input area (center area of the second stage). When two characters are entered in the input area, the cursor automatically moves to the third input area (the center area in the fourth row).

  As described above, when the input form created by the input form creation device 1 is displayed on the client terminal 3, it is based on the created HTML when the maximum number of characters is input or when the tab key is pressed. The cursor is automatically moved to the first input position in the input area of the next input order. That is, when the input form is created, the order, the maximum number of characters, and the character size in which characters are entered in the rectangular area of the form S that is the basis of the input form, the input order to each input area in the input form, the maximum number of characters, It can be reflected as the character size.

 As described above, according to the input form creation device 1, the camera 11 captures the image S of the form S by photographing the form S having a plurality of rectangular areas, and the outline of the form S is obtained based on the acquired image data. And the position of the rectangular area is detected. Next, every time the user enters characters in the rectangular area to be input next to the form S, the camera 11 captures and acquires image data of the completed form, and newly acquired image data and the previously acquired image are acquired. A difference from the data is calculated, a position of a rectangular area where a character is newly entered is detected based on the calculated difference, and the detected order is stored in association with the rectangular area. Then, based on the order stored in association with each rectangular area, an input form is created that reflects the order in which the user entered characters in the rectangular area in the input order.

  Therefore, it is possible to automatically create an input form that reflects the order in which the user entered characters in the rectangular area simply by the user filling in the rectangular area of the form and shooting it. Convenience can be improved. In particular, when shifting from paper forms to computerized forms, it is convenient to create an input form that reflects the input order without requiring specialized knowledge and effort.

In addition, it is possible to detect the size of characters included in the newly entered rectangular area and automatically create an input form that reflects the size of the detected characters. Convenience can be further improved.
In addition, it is possible to detect the number of characters included in the rectangular area where characters are newly entered, and to automatically create an input form reflecting the detected number of characters. Can be improved.

  Moreover, since the input form is described in a general-purpose HTML format, it is possible to use the input form without requiring a special configuration for starting the input form if the terminal is equipped with a Web browser. It becomes.

In addition, the description content in the said embodiment is a suitable example of the input form creation apparatus 1 which concerns on this invention, and is not limited to this.
Further, the detailed configuration and detailed operation of the input form creation device 1 can be changed as appropriate without departing from the spirit of the present invention.

It is a conceptual diagram which shows the whole structure of the form input system 100 which concerns on this invention. It is a block diagram which shows the functional structure of the input form creation apparatus 1 of FIG. It is a figure which shows the structural example of the camera 11 of FIG. (A) is a figure which shows the structural example of the memory 12 of FIG. 2, (b) is a figure which shows the structural example of the analysis information memory 14 of FIG. It is a flowchart which shows the input form creation process performed by the control apparatus 17 of FIG. It is a flowchart which shows the outline and rectangular area detection process of a form performed by the control apparatus 17 of FIG. (A) is a diagram schematically showing the captured image data acquired in step A1 of FIG. 5, (b) is a diagram schematically showing the form image data acquired in step A102 of FIG. 6, (c) ) Is a diagram showing an identification number assigned to each rectangular area detected from the form image data in step A103 in FIG. 6, and (d) is a rectangle registered in the area detection result area 141 in step A3 in FIG. It is a figure which shows an example of area information. It is a flowchart which shows the input area detection process performed by the control apparatus 17 of FIG. (A) is a diagram schematically showing the captured image data acquired in step A6 in FIG. 5, (b) is a diagram schematically showing the image data acquired in step A201 in FIG. 8, (c). FIG. 8A is a diagram schematically showing image data acquired in the previous shooting and image data acquired in the current shooting. FIG. 8D is a diagram illustrating the previous image data and the current image acquired in step A202 in FIG. It is a figure which shows the difference of data typically. It is a flowchart which shows the difference analysis process performed by the control apparatus 17 of FIG. It is a figure which shows the example of data storage of the pixel counter 131 formed in RAM of the image processing apparatus 13 of FIG. It is a flowchart which shows the character size / character number detection process performed by the control apparatus 17 of FIG. It is a figure which shows the example of data storage of the input detection result area | region 142 of FIG.4 (b). It is a figure which shows the imaging | photography process in the input form creation process of FIG. It is a flowchart which shows the web input form HTML automatic creation process performed by the control apparatus 17 of FIG. It is a flowchart which shows the style sheet automatic creation process performed by the control apparatus 17 of FIG. It is a figure which shows an example of HTML produced | generated by the web input form HTML automatic creation process of FIG. It is a figure which shows an example of the style sheet produced | generated by the style sheet automatic creation process of FIG. It is a flowchart which shows the process performed by the control apparatus 17 by step A505 of FIG. It is a figure which shows an example of the calculation result of top, left, width, font-size of each area in the process of FIG. It is a flowchart which shows the operation | movement in the client terminal 3 of the input form produced with the input form production apparatus 1 of FIG. It is a figure which shows an example of the input form displayed on the client terminal 3 of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Form input system 1 Input form creation apparatus 2 Web server 3 Client terminal 11 Camera 11a Mounting base 11b Arm 11c Mounting part 11d Digital camera 12 Memory 121 Form image area 122 Latest image area 123 Previous image area 13 Image processing apparatus 14 Analysis information memory 141 Area detection result area 142 Input detection result area 15 Input form automatic creation device 16 Creation result storage device 17 Control device 18 Program storage device 19 Input order counter 20 Communication I / F
21 Operation unit

Claims (5)

Photographing means for photographing a form having a plurality of rectangular areas and acquiring image data of the form;
A rectangular area detecting means for detecting the outline of the form and the position of the rectangular area based on the image data of the form photographed by the photographing means;
Storage means for storing information on the position of each rectangular area detected by the rectangular area detection means;
Each time a character is entered in one rectangular area of the form by the user, the completed form is photographed by the photographing means, and each time the filled form is photographed by the photographing means, the photographing is performed. The difference between the image data newly acquired by the means and the image data previously acquired by the photographing means is calculated, and the position of the rectangular area where the character is newly entered is detected based on the calculated difference. Input area detection means;
Counting means for counting the order in which the positions of the rectangular areas are detected in the input area detecting means;
Based on the image data of the form acquired by the photographing means, the position of the rectangular area detected by the input area detecting means, and the order in which the rectangular areas were detected, the order in which the user entered the rectangular area of the form Creating means to create an input form reflecting the input order,
An input form creation device characterized by comprising: Further comprising character size detection means for detecting the size of the character included in the rectangular area detected by the input area detection means;
The input form creation apparatus according to claim 1, wherein the creation unit further creates an input form reflecting a character size detected by the character size detection unit. A character number detecting means for detecting the number of characters included in the rectangular area detected by the input area detecting means;
The input form creation apparatus according to claim 1, wherein the creation unit further creates an input form reflecting the number of characters detected by the character number detection unit.   The input form creation apparatus according to claim 1, wherein the input form created by the creation unit is described in an HTML format. Computer
Photographing means for photographing a form having a plurality of rectangular areas and acquiring image data of the form,
A rectangular area detecting means for detecting the outline of the form and the position of the rectangular area based on the image data of the form photographed by the photographing means,
Storage means for storing information on the position of each rectangular area detected by the rectangular area detection means;
Each time a character is entered in one rectangular area of the form by the user, the completed form is photographed by the photographing means, and each time the filled form is photographed by the photographing means, the photographing is performed. The difference between the image data newly acquired by the means and the image data previously acquired by the photographing means is calculated, and the position of the rectangular area where the character is newly entered is detected based on the calculated difference. Input area detection means,
Counting means for counting the order in which the positions of the rectangular areas are detected in the input area detecting means;
Based on the image data of the form acquired by the photographing means, the position of the rectangular area detected by the input area detecting means, and the order in which the rectangular areas were detected, the order in which the user entered the rectangular area of the form Creating means to create an input form reflecting the input order,
Program to function as.

Images