JP6868665B2 - Data entry device, data entry method and data entry program - Google Patents

Description

The present invention relates to an input technique for the contents to be entered in a procedure document.

At places such as financial institutions and government offices, users fill out various procedure documents and submit them to the counter. However, the user may have questions regarding the entry of the procedure documents. In this case, the user needs to ask the clerk any questions and then fill out the procedure documents. It is very troublesome for the user to fill out the procedure documents while asking the clerk. In addition, it takes time and effort for the clerk who receives the question.

Patent Document 1 describes that an explanation is projected on a procedural document. In Patent Document 1, this supports the user to fill out the procedural documents so that the procedural documents can be filled out efficiently.

Japanese Unexamined Patent Publication No. 2015-191382

From the viewpoint of environmental protection, the so-called paperless office is being promoted to reduce the amount of paper used. The method described in Patent Document 1 is premised on inputting into procedural documents. Therefore, the amount of paper used has not decreased.
It is conceivable to promote paperless offices by having users operate computers and input data. However, some users may not be good at operating a computer. In this case, there is a possibility that the labor of the user and the clerk will increase.

Therefore, it is conceivable that the input format is projected and displayed on the input table, and information is input to the projected input format by an input device such as an electronic pen. This makes it possible to reduce the amount of paper used without increasing the burden of procedures on the user.
At this time, the size of the input stand on which the projection device projects and displays the input format and the like may differ depending on the installation site of the projection device. Depending on the size of the input table, it may be difficult to display all the planned content. On the contrary, depending on the size of the input table, an unnecessary space may be created.
An object of the present invention is to provide an appropriate display according to the size of an input table.

The data input device according to the present invention is
A display area recognition unit that recognizes the size of the top surface of the input stand,
A projection unit that projects and displays display content according to the size recognized by the display area recognition unit on the input table, and a projection unit.
To be equipped.

The projection unit projects and displays the display content on the input table in a size corresponding to the size.

The projection unit projects and displays the display content including the input format indicating the input content and the input field.
The data input device further
A data recognition unit that recognizes handwritten characters in the input field of the input format projected and displayed by the projection unit is provided.

When the size is larger than the reference, the projection unit projects and displays the other display contents in addition to the input format.

The data input method according to the present invention is
The display area recognition unit recognizes the size of the upper surface of the input stand and
The projection unit projects and displays the display content according to the recognized size on the input table.

The data input program according to the present invention
Display area recognition processing that recognizes the size of the top surface of the input stand,
The projection process of projecting the display content according to the size recognized by the display area recognition process onto the input table, and the projection process.
Make the computer function as a data input device.

In the present invention, the size of the upper surface of the input table is recognized, and the display content corresponding to the recognized size is projected and displayed. This makes it possible to display an appropriate display according to the size of the input table.

The block diagram of the data input system 1 which concerns on Embodiment 1. FIG. The block diagram of the data input device 10 which concerns on Embodiment 1. FIG. The flowchart of the operation of the data input system 1 which concerns on Embodiment 1. FIG. The flowchart of the projection processing which concerns on Embodiment 1. The explanatory view of the selection screen 81 of the procedure which concerns on Embodiment 1. FIG. The explanatory view of the display content storage part 51 which concerns on Embodiment 1. FIG. The explanatory view of the display content 82 which concerns on Embodiment 1. FIG. The flowchart of data recognition processing which concerns on Embodiment 1. The explanatory view of the display content 82 which concerns on Embodiment 1. FIG. The flowchart of the confirmation process which concerns on Embodiment 1. The explanatory view of the format storage part 52 which concerns on Embodiment 1. FIG. Explanatory drawing of confirmation data 88 which concerns on Embodiment 1. FIG. The explanatory view of the user information storage part 53 which concerns on Embodiment 1. FIG. The block diagram of the data input device 10 which concerns on modification 4. The block diagram of the data input system 1 which concerns on Embodiment 2. FIG. The flowchart of data recognition processing which concerns on Embodiment 2. The block diagram of the data input device 10 which concerns on Embodiment 3. The flowchart of the data recognition process which concerns on Embodiment 3. The block diagram of the data input device 10 which concerns on Embodiment 4. FIG. The flowchart of the data input system 1 which concerns on Embodiment 4. The flowchart of the loss prevention processing which concerns on Embodiment 4. The explanatory view of the loss prevention processing which concerns on Embodiment 4. The flowchart of the data input system 1 which concerns on embodiment 5. The block diagram of the data input device 10 which concerns on Embodiment 5. The flowchart of the projection processing which concerns on embodiment 5. The explanatory view of the projection processing which concerns on embodiment 5. The explanatory view of the projection processing which concerns on embodiment 5. The flowchart of the projection processing which concerns on Embodiment 6. The flowchart of the data recognition process which concerns on Embodiment 6. The flowchart of the confirmation process which concerns on Embodiment 6. The block diagram of the data input device 10 which concerns on Embodiment 7. The flowchart of the handwriting appraisal processing which concerns on Embodiment 7. The block diagram of the data input system 1 which concerns on Embodiment 8. The block diagram of the data input device 10 which concerns on Embodiment 8. The flowchart of the natural language recognition process which concerns on Embodiment 8. The explanatory view of the natural language memory part 55 which concerns on Embodiment 8. The block diagram of the data input system 1 which concerns on Embodiment 9. The block diagram of the data input device 10 which concerns on Embodiment 9. The flowchart of the screen sharing process which concerns on Embodiment 9.

Embodiment 1.
*** Explanation of configuration ***
The configuration of the data input system 1 according to the first embodiment will be described with reference to FIG.
The data input system 1 includes a data input device 10, a projector 20, an electronic pen 30, an input stand 40, and a database server 50. The data input device 10, the projector 20, and the database server 50 are connected via a transmission line 60.

The data input device 10 is a computer such as a PC (Personal Computer). The projector 20 is a device that projects and displays data such as an input format on an input table 40 under the control of the data input device 10. The electronic pen 30 is a device for inputting to an input format projected and displayed on the input table 40. Characters (characters include characters, numbers, figures, symbols and check marks) are handwritten and a button is clicked. It is a device for performing operations such as. The input table 40 is a table on which data is projected and displayed by the projector 20. The database server 50 is a computer that stores data such as an input format.

The configuration of the data input device 10 according to the first embodiment will be described with reference to FIG.
The data input device 10 includes hardware for a processor 11, a memory 12, a storage 13, and a communication interface 14. The processor 11 is connected to other hardware via a signal line and controls these other hardware.

The processor 11 is an IC (Integrated Circuit) that performs processing. Specific examples of the processor 11 are a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and a GPU (Graphics Processing Unit).

The memory 12 is a storage device that temporarily stores data. Specific examples of the memory 12 are SRAM (Static Random Access Memory) and DRAM (Dynamic Random Access Memory).

The storage 13 is a storage device for storing data. As a specific example, the storage 13 is an HDD (Hard Disk Drive). The storage 13 includes an SD (registered trademark, Secure Digital) memory card, a CF (CompactFlash), a NAND flash, a flexible disk, an optical disk, a compact disk, a Blu-ray (registered trademark) disk, and a DVD (Digital Versaille).
It may be a portable storage medium such as Disk).

The communication interface 14 is an interface for communicating with an external device such as the projector 20 and the database server 50. As a specific example, the communication interface 14 is a port of Ethernet (registered trademark), USB (Universal Serial Bus), HDMI (registered trademark, High-Definition Multimedia Interface).

The data input device 10 includes a projection unit 111, a data recognition unit 112, and a confirmation processing unit 113 as functional components. The functions of the projection unit 111, the data recognition unit 112, and the confirmation processing unit 113 are realized by software.
The storage 13 stores a program that realizes the functions of the projection unit 111, the data recognition unit 112, and the confirmation processing unit 113. This program is read into the memory 12 by the processor 11 and executed by the processor 11. As a result, the functions of the projection unit 111, the data recognition unit 112, and the confirmation processing unit 113 are realized.

In FIG. 2, only one processor 11 is shown. However, the data input device 10 may include a plurality of processors that replace the processor 11. These plurality of processors share the execution of the program that realizes the functions of the projection unit 111, the data recognition unit 112, and the confirmation processing unit 113. Each processor is an IC that performs processing in the same manner as the processor 11.

The database server 50 realizes the functions of the display content storage unit 51, the format storage unit 52, and the user information storage unit 53.

*** Explanation of operation ***
The operation of the data input system 1 according to the first embodiment will be described with reference to FIGS. 3 to 13.
The operation of the data input system 1 according to the first embodiment corresponds to the data input method according to the first embodiment. Further, the operation of the data input system 1 according to the first embodiment corresponds to the processing of the data input program according to the first embodiment.

(Step S1: Projection processing in FIG. 3)
The projection unit 111 projects and displays the input format 84 in which the input contents 85 and the input field 86 are specified by the projector 20 on the input table 40 for the procedure selected by the user.

The projection process according to the first embodiment will be described with reference to FIGS. 4 to 7.
(Step S11 in FIG. 4: Procedure selection process)
As shown in FIG. 5, the projection unit 111 displays the procedure selection screen 81 on the input table 40 by the projector 20. The selection screen 81 shows buttons for selectable procedures. In FIG. 5, as the procedure buttons, account opening, deposit withdrawal, address change, name change, seal change, and transfer are shown. The selection screen 81 is displayed on a part of the projectable projection surface 21 of the projector 20 on the input table 40.
Then, the user touches and selects the button of the procedure to be performed by the electronic pen 30.

(Step S12 in FIG. 4: Display content reading process)
The projection unit 111 reads the display content 82 for the procedure selected in step S11 from the display content storage unit 51 of the database server 50.
As shown in FIG. 6, the display content storage unit 51 stores the display content 82 for each procedure. The display content 82 includes a list 83 showing the input order of the input content 85 for the target procedure, and an input format 84 for each input content 85.
For example, when the procedure is to open an account, the list 83 indicates that the input contents 85 are in the order of inputting the name, address, date of birth, telephone number, and amount. The display content 82 includes an input format 84 for a name, an address, a date of birth, a telephone number, and an amount of money.

(Step S13 of FIG. 4: Display content projection process)
The projection unit 111 projects and displays the display content 82 read in step S12 on the input base 40 by the projector 20.
As shown in FIG. 7, when the account opening is selected in step S11, the projection unit 111 projects and displays the list 83 and the input format 84 for the name whose input order is the first input content 85. In the list 83, a plurality of input contents 85 are arranged in the input order, and the input contents 85 to be input are indicated by the stars. The input format 84 indicates an input content 85 and an input field 86.

At this time, the projection unit 111 may project and display at least one of the explanation and the input example according to the input content 85 on the input table 40. The projection unit 111 may project and display a moving image explaining the input method on the input table 40.

Further, as shown in FIG. 7, the projection unit 111 may display buttons for enlarging and reducing the displayed contents. When the enlargement button is touched, the projection unit 111 enlarges and displays the entire display content 82. That is, as shown in FIG. 7, since the display content 82 is displayed on a part of the projection surface 21, the entire display content 82 can be enlarged and displayed. Further, when the reduction button is touched, the projection unit 111 reduces the entire display content 82 and displays it.

(Step S2 in FIG. 3: Data recognition process)
The data recognition unit 112 recognizes the characters handwritten in the input field 86 of the input format 84 projected and displayed by the projection unit 111 in step S1.

The data recognition process according to the first embodiment will be described with reference to FIGS. 8 to 9.
(Step S21 in FIG. 8: Recognition process)
By the user, the content corresponding to the input content 85 is handwritten in the input field 86 by the electronic pen 30. For example, as shown in FIG. 7, when the input format 84 for the name is projected and displayed, the user's name is handwritten in the input field 86.
The data recognition unit 112 recognizes the handwritten characters each time the handwriting is performed in the input field 86. That is, the data recognition unit 112 re-recognizes the character each time the input field 86 is handwritten with one stroke.
At this time, first, the data recognition unit 112 identifies the locus of the position of the electronic pen 30. Any method may be used to specify the locus of the position. For example, the data recognition unit 112 may specify the locus of the position by communicating with the electronic pen 30, or the projector 20 spreads infrared rays on the input table 40 to specify the locus of the position of the electronic pen 30. You may. When infrared rays are used, it is possible to write characters with a finger or the like instead of the electronic pen 30.
Next, the data recognition unit 112 performs OCR (Optical Character Reader) processing based on the specified locus, recognizes the handwritten character, and converts it into a character code. The OCR process is a process of optically reading handwritten or printed characters and converting them into a character code that can be used by a computer. The data recognition unit 112 may use any OCR software. For example, the data recognition unit 112 uses OCR software that recognizes characters in consideration of the shape of the written characters, the stroke order, and the like.

(Step S22 of FIG. 8: Deficiency determination process)
The data recognition unit 112 determines whether or not there is a defect in the character recognized in step S21. For example, the data recognition unit 112 determines that there is a defect when a character other than a numerical value is input to the input field 86 for inputting a numerical value.

(Step S23 in FIG. 8: Imaging process)
The data recognition unit 112 images the locus identified in step S21 and transmits the imaged locus to the projection unit 111. Further, the data recognition unit 112 transmits the character recognized by the OCR process in step S21 to the projection unit 111.
For example, as shown in FIG. 7, the imaged locus is displayed in the input field 86. In addition, the characters converted into character strings by the OCR process are displayed below the input field 86.

When the data recognition unit 112 determines in step S22 that there is a defect, the data recognition unit 112 notifies the user of the defect and prompts the user to correct it.
For example, when the data recognition unit 112 determines in step S22 that there is a defect, the data recognition unit 112 transmits to the projection unit 111 data indicating that there is a defect together with the character string-converted character. The projection unit 111 notifies the user that there is a defect by a method such as marking the recognized characters and projecting and displaying them.

(Step S24 of FIG. 8: Writing end determination process)
The data recognition unit 112 determines whether or not the writing to the input field 86 is completed. Here, the data recognition unit 112 determines that the writing to the input field 86 is completed when the button indicating that the writing to the input field 86 is completed is touched. In FIG. 7, the data recognition unit 112 determines that writing to the input field 86 has been completed when the arrow button at the lower right of the input format 84 is touched.
When it is determined that the writing to the input field 86 is completed, the data recognition unit 112 proceeds to the process in step S25. On the other hand, when it is determined that the writing to the input field 86 has not been completed, the data recognition unit 112 returns the process to step S21 and recognizes the next character.
When the writing to the input field is completed, the data recognition unit stores the recognized characters as digital data in the memory 12, and images the specified locus and stores it in the memory 12 as trail data.

When it is determined that the writing to the input field 86 is completed, the data recognition unit 112 may redetermine whether or not there is a defect in the characters written in the input field 86.
In step S22, it is possible to determine the deficiency of one recognized character. On the other hand, when it is determined that the writing to the input field 86 is completed, it is possible to determine that the character string written in the input field 86 is inadequate. For example, when the input content 85 is a telephone number, it can be determined that the number of digits of the written numerical value is large or small.

(Step S25 in FIG. 8: Procedure end determination process)
The data recognition unit 112 determines whether or not the writing of all the input contents 85 is completed. Here, when the writing of the last input content 85 to the input field 86 is completed, it is determined that the writing of all the input content 85 is completed.
When it is determined that the writing of all the input contents 85 is completed, the data recognition unit 112 proceeds to step S3 of FIG. On the other hand, when the writing of all the input contents 85 is not completed, the data recognition unit 112 returns the process to step S13 of FIG. 4 and displays the input format 84 for the next input contents 85.

For example, when the input format 84 for the name shown in FIG. 7 is projected and displayed, and the arrow button at the lower right is touched, the data recognition unit 112 performs the process in step S13 of FIG. Return to. Then, as shown in FIG. 9, the projection unit 111 projects and displays the input format 84 for the address whose input order is the second input content 85.

(Step S3 in FIG. 3: Confirmation process)
The confirmation processing unit 113 generates confirmation data 88 for confirming the characters written in step S2.

The confirmation process according to the first embodiment will be described with reference to FIGS. 10 to 13.
(Step S31 in FIG. 10: Format acquisition process)
The confirmation processing unit 113 reads the format 87 of the procedure document for the procedure selected in step S11 from the format storage unit 52 of the database server 50.
As shown in FIG. 11, the format storage unit 52 stores the format of the procedure document for each procedure. The format 87 of the procedural document is, for example, the same format as the conventional paper procedural document. Each input field 86 indicated by the input format 84 of the display content 82 corresponds to an entry field of the procedure document.

(Step S32 in FIG. 10: Confirmation data generation process)
As shown in FIG. 12, the confirmation processing unit 113 puts the character recognized in step S2 into the entry field of the procedure document format 87 acquired in step S31, which corresponds to the input field 86 in which the character is handwritten. Shown to generate confirmation data 88. In FIG. 12, confirmation data 88 in the case of opening an account is shown. Therefore, in FIG. 12, a name, an address, a date of birth, a telephone number, and an amount of money are shown.

When the confirmation processing unit 113 generates the confirmation data 88, the confirmation processing unit 113 may redetermine whether or not there is a defect in the characters written in each input field 86. Here, it can be determined whether or not there is a defect in the correspondence between the character strings written in each input field 86. For example, it can be determined that the address and the area code of the telephone number do not match.

(Step S33 in FIG. 10: Procedure execution determination process)
The confirmation processing unit 113 transmits the generated confirmation data 88 to the projection unit 111. The projection unit 111 projects and displays the confirmation data 88 on the input table 40.
The content of the confirmation data 88 is confirmed by the user. If there is no correction in the content of the confirmation data 88, the electronic pen 30 touches a button indicating that the procedure is executed by the user. Then, the confirmation processing unit 113 advances the processing to step S34. On the other hand, if the content of the confirmation data 88 is corrected, the electronic pen 30 touches a button indicating that the content is corrected by the user. Then, the confirmation processing unit 113 causes the projection unit 111 to project and display the correction screen for the corresponding input content 85. Then, after the correction is completed, the confirmation processing unit 113 returns the processing to step S32 and regenerates the confirmation data 88.

(Step S34 in FIG. 10: User information storage processing)
The confirmation processing unit 113 transmits data such as characters for each input content 85 recognized in step S2 to the terminal of the clerk at the procedure destination such as a financial institution. When the clerk confirms that the data is complete, the confirmation processing unit 113 writes the data to the user information storage unit 53 of the database server 50. As shown in FIG. 13, the user information storage unit 53 stores information about the user for each user.

(Step S35 of FIG. 10: Reference information generation process)
The confirmation processing unit 113 generates reference information 89 for referring to information about the procedure document from the user terminal. Information about the procedure documents includes information about the registered users and the progress of the procedure. Reference information 89 indicates a URL (Uniform Resource Locator) in which information about the procedure document can be referred to. For example, the reference information 89 is a two-dimensional code in which a URL is embedded. User terminals are terminals such as smartphones and mobile phones. The user can refer to the information about the procedure documents by accessing the website by designating the URL indicated by the reference information 89 using the user terminal.
The confirmation processing unit 113 transmits the generated reference information 89 to the projection unit 111. The projection unit 111 projects and displays the reference information 89 on the input table 40. For example, the URL indicated by the reference information 89 can be imported into the user terminal by reading the two-dimensional code using the camera attached to the user terminal.

The procedure is carried out by a clerk at a procedure destination such as a financial institution using the data written in the user information storage unit 53 in step S34 of FIG. Then, the progress of the procedure is registered in the database server 50 by the clerk, and the information on the website of the URL indicated by the reference information 89 is updated.

*** Effect of Embodiment 1 ***
As described above, the data input device 10 according to the first embodiment projects the input format 84 onto the input table 40 and recognizes the characters handwritten in the input field 86 of the input format 84. This makes it possible to apply for procedures without using paper, and it is possible to reduce the amount of paper used.

In addition, the user may handwrite the characters in the input field 86 in the same manner as when writing the characters in the procedure document. In other words, the user does not have to perform a process different from the case of filling out a conventional paper document, such as hitting the keyboard, and the time and effort of the procedure does not increase.

In addition, when applying for a procedure using paper procedure documents, the clerk entered the contents entered in the procedure documents into the computer. Therefore, there is a risk that the data will not be registered correctly due to an input error of the clerk.
The data input device 10 according to the first embodiment confirms the character recognized by the user and converted into a character string. Therefore, the data as intended by the user is registered.

Further, the data input device 10 according to the first embodiment generates reference information 89. Therefore, the user can check the progress of the procedure.

Further, the data input device 10 according to the first embodiment projects and displays the input format 84. Therefore, the display of the input format 84 can be enlarged or reduced. In particular, the projection surface 21 can be easily enlarged. Therefore, it is possible to easily realize that the input format 84 is displayed in a large size.
Further, the description and the input example according to the input content 85 can be displayed on the input format 84, or can be displayed outside the input format 84.

Further, the data input device 10 according to the first embodiment projects and displays an explanation and an input example according to the input content 85. Therefore, the user can smoothly write the input content 85. As a result, it is possible to alleviate the congestion at the procedure window. In addition, since the number of inquiries to the clerk is reduced, it is possible to reduce the inability of the clerk to work.

Further, the data input device 10 according to the first embodiment stores the characters recognized by the OCR process as digital data, and images the specified locus and stores it as trail data. Therefore, even if the user inquires about the procedure contents at a later date, it is possible to confirm the procedure contents.

Further, the data input device 10 according to the first embodiment does not require paper procedure documents. Therefore, if there is a change in the input content 85 required for the procedure, it can be dealt with simply by changing the data stored in the database server 50.
When the explanation is projected onto the procedure document as in Patent Document 1, complicated work such as changing the paper procedure document and adjusting the position of the explanation projected on the procedure document is required.

*** Other configurations ***
<Modification example 1>
In the first embodiment, the data input system 1 includes one set of a data input device 10, a projector 20, an electronic pen 30, and an input stand 40. However, the data input system 1 may include a plurality of sets of a data input device 10, a projector 20, an electronic pen 30, and an input stand 40.

<Modification 2>
In the first embodiment, the database server 50 realizes the functions of the display content storage unit 51, the format storage unit 52, and the customer information storage unit 53. However, the storage 13 of the data input device 10 may realize the functions of the display content storage unit 51, the format storage unit 52, and the customer information storage unit 53.

<Modification example 3>
In the first embodiment, the input field 86 is handwritten. However, the data input system 1 may provide an input means other than handwriting. For example, the data input system 1 may include a numeric keypad. This allows the user to enter a numerical value from the numeric keypad. Further, the data input system 1 may include a keyboard. As a result, a user who is accustomed to keyboard input can input characters from the keyboard. The numeric keypad and keyboard may be physically prepared, or a projection type numeric keypad and keyboard may be prepared. When a projection type numeric keypad and keyboard are prepared, the projection unit 111 of the data input device 10 may project the numeric keypad and keyboard onto the input table 40 by the projector 20.

<Modification example 4>
In the first embodiment, the functions of the projection unit 111, the data recognition unit 112, and the confirmation processing unit 113 are realized by software. However, as a modification 4, the functions of the projection unit 111, the data recognition unit 112, and the confirmation processing unit 113 may be realized by hardware. The difference between the modified example 4 and the first embodiment will be described.

The configuration of the data input device 10 according to the modified example 4 will be described with reference to FIG.
When the functions of the projection unit 111, the data recognition unit 112, and the confirmation processing unit 113 are realized by hardware, the data input device 10 replaces the processor 11, the memory 12, and the storage 13 with the processing circuit 15. Be prepared. The processing circuit 15 is a dedicated electronic circuit that realizes the functions of the projection unit 111, the data recognition unit 112, the confirmation processing unit 113, and the functions of the memory 12 and the storage 13.

The processing circuit 15 is assumed to be a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, a logic IC, a GA (Gate Array), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array). Will be done.
The functions of the projection unit 111, the data recognition unit 112, and the confirmation processing unit 113 may be realized by one processing circuit 15, or the functions of the projection unit 111, the data recognition unit 112, and the confirmation processing unit 113. May be distributed to a plurality of processing circuits 15 and realized.

<Modification 5>
As a modification 5, some functions may be realized by hardware and other functions may be realized by software. That is, some of the functions of the projection unit 111, the data recognition unit 112, and the confirmation processing unit 113 may be realized by hardware, and other functions may be realized by software.

The processor 11, the memory 12, the storage 13, and the processing circuit 15 are collectively referred to as a "processing circuit Lee". That is, the function of each functional component is realized by the processing circuit.

Embodiment 2.
The second embodiment is different from the first embodiment in that a document such as a driver's license of a car is read. In the second embodiment, these different points will be described, and the same points will be omitted.

*** Explanation of configuration ***
The configuration of the data input system 1 according to the second embodiment will be described with reference to FIG.
The data input system 1 is different from the data input system 1 shown in FIG. 1 in that it includes an imaging device 70. The image pickup device 70 is a device that captures a document such as a driver's license of an automobile.

*** Explanation of operation ***
The data recognition process according to the second embodiment will be described with reference to FIG.
The process from step S42 to step S46 is the same as the process from step S21 to step S25 in FIG.

(Step S41 of FIG. 16: Reading process)
A document such as a driver's license of a car is installed in the imaging area of the imaging device 70 by the user.
The data recognition unit 112 takes an image of the document installed in the image pickup region by the image pickup apparatus 70, and acquires the image data of the document. The data recognition unit 112 recognizes characters corresponding to each input content 85 from the acquired image data. The data recognition unit 112 treats the recognized characters as the characters input in the corresponding input field 86 in the input format 84.
Here, a document that defines the input contents, such as a driver's license of a car, is installed. In addition, it is not limited to a driver's license of a car, and may be other documents such as a passport and an insurance card. Further, each field of the document and each input content 85 of the display content 82 are associated with each other in advance.
The data recognition unit 112 transmits the recognized characters to the projection unit 111. Then, the characters recognized by the projection unit 111 are displayed below the input field 86. Alternatively, it may be displayed together with the input field 86, or may be displayed only in the input field 86.

*** Effect of Embodiment 2 ***
As described above, the data input device 10 according to the second embodiment recognizes the characters described in the document such as the driver's license of the automobile and treats them as the characters input in the input field 86. This makes it possible to reduce the time and effort for the user to write the input content 85.

Embodiment 3.
The third embodiment is different from the first embodiment in that statistics on writing are collected. In the third embodiment, these different points will be described, and the same points will be omitted.
It is also possible to combine the third embodiment with the second embodiment.

*** Explanation of configuration ***
The configuration of the data input device 10 according to the third embodiment will be described with reference to FIG.
The data input device 10 is different from the data input device 10 shown in FIG. 3 in that the data input device 10 includes the statistics unit 114 as a functional component. The statistics unit 114 is realized by software like other functional components. The statistics unit 114 may be realized by hardware like other functional components.
Further, the database server 50 realizes the function of the statistical storage unit 54.

*** Explanation of operation ***
The data recognition process according to the third embodiment will be described with reference to FIG.
The processing of steps S51 to S55 is the same as the processing of steps S21 to S25 of FIG.

(Step S56 of FIG. 18: Statistical processing)
The statistics unit 114 acquires the contents determined to be inadequate in step S52 or step S54 and writes them in the statistics storage unit 54. Further, the statistics unit 114 also acquires the writing time in each input field 86 and writes it in the statistics storage unit 54.

As a result, the statistical storage unit 54 stores data on the deficiency and data on the writing time. For example, a clerk or the like analyzes data on deficiencies and writing times, changes the input format 84, or adds a description of the input content 85. For example, with respect to the input content 85 having many deficiencies, the explanation regarding the input content 85 is additionally projected and displayed so that the deficiencies are reduced.

*** Effect of Embodiment 3 ***
As described above, the data input device 10 according to the third embodiment accumulates data such as deficiencies. Thereby, the input format 84 and the description can be improved. As a result, the system can be made easier for the user to use.

Embodiment 4.
The fourth embodiment is different from the first embodiment in that the loss prevention process of the electronic pen 30 is performed. In the fourth embodiment, these different points will be described, and the same points will be omitted.
It is also possible to combine the fourth embodiment with the second and third embodiments.

*** Explanation of configuration ***
The configuration of the data input device 10 according to the fourth embodiment will be described with reference to FIG.
The data input device 10 is different from the data input device 10 shown in FIG. 2 in that the arrangement determination unit 115 is provided as a functional component. The arrangement determination unit 115 is realized by software like other functional components. The arrangement determination unit 115 may be realized by hardware like other functional components.

*** Explanation of operation ***
The operation of the data input system 1 according to the fourth embodiment will be described with reference to FIG.
The processing of steps S1 to S3 is the same as that of the first embodiment.

(Step S4 in FIG. 20: Loss prevention processing)
The projection unit 111 projects and displays the arrangement area 90, which is a storage place for the electronic pen 30, which is an input device, on the input table 40 by the projector 20. Then, the arrangement determination unit 115 determines whether or not the electronic pen 30, which is an input device, is placed in the arrangement area 90 projected by the projection unit 111 for a reference time or longer.

The loss prevention process according to the fourth embodiment will be described with reference to FIGS. 21 to 22.
(Step S61 of FIG. 21: Area display processing)
The projection unit 111 projects and displays the arrangement area 90, which is the place where the electronic pen 30 is placed, on the input table 40 by the projector 20. For example, as shown in FIG. 22, the projection unit 111 places an arrangement area 90 having an enlarged shape of the electronic pen 30 on the input table 40 together with a message 91 urging the electronic pen 30 to be placed in the arrangement area 90. Project to display.
That is, the projection unit 111 projects and displays the input format 84 on the input table 40 in steps S11 to S13, and projects and displays the arrangement area 90 after the input to the input format 84 is completed.

The arrangement area 90 in FIG. 22 has the shape of a pen, but the shape is not limited to the pen. It may be a rectangle or a circle, or it may be a point or a line. Further, the size of the area does not necessarily have to be the size that the pen can be inserted, and may be the size that the pen tip can be inserted.

(Step S62 of FIG. 21: Arrangement determination process)
The placement determination unit 115 determines whether or not the electronic pen 30 has been continuously placed in the placement area 90 for a reference time or longer. At this time, when the pointer of the electronic pen 30 points to the inside of the arrangement area 90, the arrangement determination unit 115 determines that the electronic pen 30 is placed in the arrangement area 90. On the other hand, when the pointer of the electronic pen 30 points to the outside of the arrangement area 90, the arrangement determination unit 115 determines that the electronic pen 30 is not placed in the arrangement area 90.
When the electronic pen 30 is continuously placed in the placement area 90 for the reference time or longer, the placement determination unit 115 proceeds to step S63.
On the other hand, if the electronic pen 30 is not continuously placed in the placement area 90 for the reference time or longer even after the time limit has elapsed, the placement determination unit 115 proceeds to step S64. Here, the time limit is a time longer than the reference time. As a specific example, the time limit is 10 seconds and the reference time is 3 seconds.

(Step S63 in FIG. 21: Normal termination processing)
The placement determination unit 115 ends the process, assuming that the electronic pen 30 has been returned to the placement area 90.

(Step S64 of FIG. 21: Abnormal termination processing)
The placement determination unit 115 notifies at least one of the person in charge and the user by sounding a warning sound or sending a message to the person in charge, assuming that the electronic pen 30 has not been returned to the arrangement area 90. , End the process.

*** Effect of Embodiment 4 ***
As described above, when the input is completed, the data input device 10 according to the fourth embodiment projects and displays the arrangement area 90, which is the storage place of the electronic pen 30, on the input table 40.
There is a possibility that the user forgets to put the electronic pen 30 and takes it away even though he / she does not intend to take the electronic pen 30 away. However, by projecting and displaying the arrangement area 90 on the input table 40, the user is prompted to place the electronic pen 30 and it is possible to prevent the electronic pen 30 from being accidentally taken away. Further, if the electronic pen 30 is placed at an arbitrary position, the next user may not be able to find the electronic pen 30. However, by projecting and displaying the arrangement area 90 on the input table 40, the place where the electronic pen 30 is placed is unified, and the next user can easily find the electronic pen 30.
As a result, it is possible to prevent the electronic pen 30 from being lost.

Further, when the electronic pen 30 is not placed in the arrangement area 90, it is notified by a method such as sounding a warning sound or sending a message to the person in charge. By sounding the warning sound, it is possible to prevent the electronic pen 30 from being taken away. Further, by sending a message to the person in charge, even if the electronic pen 30 is lost, a new electronic pen 30 can be replenished at an early stage.

*** Other configurations ***
<Modification 6>
In the fourth embodiment, the loss prevention process was executed after the processes of steps S1 to S3 of FIG. That is, after the data input to the input format 84 is completed and the data registration is completed, the loss prevention process is executed.
However, the data may be registered when the electronic pen 30 is placed. Specifically, the confirmation data 88 may be projected and displayed on the input table 40 in step S33 of FIG. 10, and the loss prevention process may be executed at the same time. That is, in step S33 of FIG. 10, the confirmation data 88 is projected and displayed on the input table 40, and the arrangement area 90 is projected and displayed on the input table 40. If there is no correction in the content of the confirmation data 88, the electronic pen 30 is placed in the arrangement area 90. Then, when the electronic pen 30 is continuously placed in the arrangement area 90 for the reference time or longer, the process proceeds to step S34 in FIG.
That is, in the first embodiment, if the content of the confirmation data 88 is not modified, the button indicating that the procedure is executed by the user is touched by the electronic pen 30. However, in the modification 6, if the content of the confirmation data 88 is not corrected, the electronic pen 30 is placed in the arrangement area 90 instead of the touch by the electronic pen 30. As a result, the procedure cannot be executed unless the electronic pen 30 is placed in the arrangement area 90, so that the loss of the electronic pen 30 can be prevented more reliably.

<Modification 7>
The arrangement determination unit 115 may periodically determine whether or not the electronic pen 30 is placed in the arrangement area 90 even after the normal end processing of step S63 in FIG. 21 is completed. At this time, the arrangement area 90 does not need to be projected and displayed. That is, when the normal end processing of step S63 in FIG. 21 is completed, the arrangement area 90 disappears, but the arrangement determination unit 115 places the electronic pen 90 at the position of the arrangement area 90 displayed in step S61 of FIG. Determine if it is.
Then, when the electronic pen 30 is not continuously placed in the arrangement area 90 for a certain period of time, the arrangement determination unit 115 causes the person in charge and the user to sound a warning sound or send a message to the person in charge. You may notify at least one of.

Embodiment 5.
The fifth embodiment is different from the first embodiment in that the display content 82 is controlled according to the size of the input table 40. In the fifth embodiment, these different points will be described, and the same points will be omitted.
It is also possible to combine the fifth embodiment with the second to fourth embodiments.

*** Explanation of configuration ***
The configuration of the data input system 1 according to the fifth embodiment will be described with reference to FIG. 23.
The data input system 1 is different from the data input system 1 shown in FIG. 1 in that the sensor 71 is provided. The sensor 71 is a device that detects the size of the input base 40.

The configuration of the data input device 10 according to the fifth embodiment will be described with reference to FIG. 24.
The data input device 10 is different from the data input device 10 shown in FIG. 2 in that it includes a display area recognition unit 116. The display area recognition unit 116 is realized by software like other functional components. The display area recognition unit 116 may be realized by hardware like other functional components.

*** Explanation of operation ***
The projection process according to the fifth embodiment will be described with reference to FIGS. 25 to 27.
The process of step S75 is the same as the process of step S12 of FIG.

(Step S71: Size detection process)
The display area recognition unit 116 recognizes the size of the arrangement area where the input device is placed by the sensor 71. Specifically, the vertical and horizontal dimensions of the input base 40 are recognized.

(Step S72: Content identification process)
The projection unit 111 specifies the display content according to the size of the upper surface of the input base 40 detected in step S71.
A plurality of layouts of display contents according to the size of the arrangement area are held in advance for each size of the contents to be displayed, and the contents are uniquely determined by the size detected by the size detection process.
As a specific example, an example in which three types of layouts, large, medium, and small, are registered will be described. The projection unit 111 identifies whether the size of the upper surface of the detected input base 40 corresponds to the classification of large, medium, and small. The projection unit 111 identifies the display content according to the specified classification.
For example, when the classification is large, the selection screen 81 or the display content 82 and the advertisement video and the advertisement image are used as the display contents, and when the classification is medium, the selection screen 81 or the display content 82 and the advertisement video are used. Is the display content, and when the classification is small, only the selection screen 81 or the display content 82 is the display content.

(Step S73: Projection size determination process)
The projection unit 111 specifies the display content according to the size of the arrangement area specified in step S72 from the layout in which the display content is registered, and matches the display content of the specified layout with the size of the detected input stand. To enlarge.

(Step S74: Procedure selection process)
The projection unit 111 projects and displays the procedure selection screen 81 on the input table 40 by the projector 20. At this time, in the above example, when the classification is large, the projection unit 111 projects and displays the advertisement video and the advertisement image on the input table 40 together with the selection screen 81. Further, when the classification is medium, the projection unit 111 projects and displays the advertisement video on the input table 40 together with the selection screen 81.
For example, when the classification is medium, as shown in FIG. 26, the projection unit 111 projects and displays the selection screen 81 and the advertisement moving image on the input table 40.
Then, the user touches and selects the button of the procedure to be performed by the electronic pen 30. At this time, the user may watch the advertisement video.

(Step S76: Display content projection process)
The projection unit 111 projects and displays the display content 82 read in step S75 on the transmission line 60 by the projector 20. At this time, in the above example, when the classification is large, the projection unit 111 projects and displays the advertisement video and the advertisement image on the input table 40 together with the selection screen 81. Further, when the classification is medium, the projection unit 111 projects and displays the advertisement video on the input table 40 together with the selection screen 81.
For example, when the classification is medium, as shown in FIG. 27, the projection unit 111 projects and displays the selection screen 81 and the advertisement moving image on the input table 40.
After that, the data recognition process of step S2 of FIG. 3 is executed. At this time, the user may watch the advertisement video.

*** Effect of Embodiment 5 ***
As described above, the data input device 10 according to the fifth embodiment determines the display content according to the size of the upper surface of the input table 40. As a result, appropriate content can be projected and displayed according to the prepared input stand 40.

Further, the data input device 10 according to the fifth embodiment enlarges and projects the determined display content according to the size of the upper surface of the input table 40.

Embodiment 6.
The sixth embodiment is different from the first embodiment in that when a plurality of procedures are performed in succession, the contents already input in the other procedures are used. In the sixth embodiment, these different points will be described, and the same points will be omitted.
It is also possible to combine the sixth embodiment with the second to fifth embodiments.

*** Explanation of operation ***
The projection process according to the sixth embodiment will be described with reference to FIGS. 28 and 5.
(Step S81 in FIG. 28: Procedure selection process)
As in the first embodiment, the procedure is selected. In Embodiment 6, one or more procedures are selected.
Specifically, as shown in FIG. 5, the projection unit 111 displays the procedure selection screen 81 on the input table 40 by the projector 20. Then, the user touches the buttons of the procedure to be performed in order with the electronic pen 30, and one or more procedures are selected.

The projection unit 111 sets each procedure selected in step S81 as a target procedure in order. Here, the projection unit 111 targets each procedure in the order selected in step S81.

(Step S82 of FIG. 28: Display content reading process)
The projection unit 111 reads the display content 82 for the target procedure from the display content storage unit 51 of the database server 50.

(Step S83 of FIG. 28: Display content projection process)
The projection unit 111 projects and displays the display content 82 read in step S12 on the input base 40 by the projector 20.

The data recognition process according to the sixth embodiment will be described with reference to FIG. 29.
(Step S91 in FIG. 29: Procedure number determination process)
The data recognition unit 112 determines whether or not the number of procedures selected in step S81 of FIG. 28 is one.
When the number of procedures is two or more, the data recognition unit 112 advances the process to step S92. On the other hand, when the number of procedures is one, the data recognition unit 112 advances the process to step S95.

(Step S92 in FIG. 29: Initial procedure determination process)
The data recognition unit 112 determines whether or not the target procedure is the first procedure. That is, the data recognition unit 112 determines whether or not the target procedure is the procedure to be processed first among the procedures selected in step S81 of FIG. 28.
If the target procedure is not the first procedure, the data recognition unit 112 advances the process to step S93. On the other hand, when the target procedure is the first procedure, the data recognition unit 112 advances the process to step S95.

(Step S93 in FIG. 29: Entry content determination process)
The data recognition unit 112 determines whether or not the input content 85 is the already-existing content that is the input content 85 included in the past procedure that has already been the target.
If the input content 85 is the already-existing content input in the past procedure, the data recognition unit 112 proceeds to step S94. On the other hand, if the input content 85 is not the content input in the past procedure, the data recognition unit 112 proceeds to step S95.

(Step S94 of FIG. 29: Data reading process)
The data recognition unit 112 reads the data input in the past procedure for the input content 85 from the memory 12 and projects and displays it on the projection unit 111.
Specifically, the data recognition unit 112 reads out from the memory 12 the digital data of the characters recognized in the past procedure for the input content 85 and the data in which the trajectory specified in the past procedure is imaged for the input content 85. .. The data recognition unit 112 transmits the read digital data and the imaged data to the projection unit 111. Then, the projection unit 111 projects and displays the characters indicated by the digital data and the imaged data on the input table 40. Here, the imaged data is projected and displayed in the input field 86, and the characters indicated by the digital data are projected and displayed in the vicinity of the input field 86.
Then, the data recognition unit 112 advances the process to step S98.

That is, when the projection unit 111 projects and displays the input format of the past procedure with respect to the already-existing content which is the input content already included in the past procedure which has already been the target among the plurality of input contents of the target procedure. The characters recognized by the data recognition unit 112 are projected and displayed as the characters input in the input field 86 corresponding to the existing contents. At the same time, the projection unit 111 projects and displays the imaged data indicating the locus input in the input field 86 corresponding to the already-existing content in the input field 86.

The process from step S95 to step S99 is the same as the process from step S21 to step S25 in FIG. However, in step S99, if the data recognition unit 112 has not completed writing of all the input contents 85, the process returns to step S83 of FIG. 28, and the input format 84 for the next input contents 85 Is displayed.

If it is desired to change the content read and projected in step S94, the locus displayed in the input field 86 may be deleted and the input may be re-entered. When the input is re-entered, the process is returned from step S98 to step S95. Then, the processes of steps S95 to S97 are executed for the re-entered contents. As a result, characters are recognized from the re-input locus, and the recognized characters and the data obtained by imaging the re-input locus are projected and displayed on the input table 40.
That is, when the information projected and displayed in the input field 86 corresponding to the existing content is deleted in step S94 and handwritten again, the data recognition unit 112 recognizes the handwritten characters. Then, the projection unit 111 stops the projection display of the character recognized by the data recognition unit 112 when the input format 84 of the past procedure is projected and displayed, and projects and displays the character newly recognized by the data recognition unit 112.

Further, the data recognition unit 112 identifies the handwritten locus, recognizes the handwritten character based on the specified locus, and determines the specified locus and the recognized character, as in the first embodiment. Store in association with each other. At this time, if the data recognition unit 112 is not handwritten in the input field 86 corresponding to the existing content, the data recognition unit 112 projects and displays the trajectory handwritten in the input field 86 indicated by the input format 84 of the past procedure and the input format of the past procedure. When this is done, the characters recognized by the data recognition unit are stored in association with each other.

The confirmation process according to the sixth embodiment will be described with reference to FIG.
The process from step S101 to step S105 is the same as the process from step S31 to step S35 in FIG.

(Step S106 of FIG. 30: Procedure determination process)
The confirmation processing unit 113 determines whether or not unprocessed procedures remain. That is, the confirmation processing unit 113 determines whether or not, among the procedures selected in step S81 of FIG. 28, there are still procedures that have not been processed.
If the unprocessed procedure remains, the confirmation processing unit 113 returns the process to step S82 in FIG. 28. Then, the confirmation processing unit 113 causes the projection unit 111 to read the display content 82 of the next procedure. On the other hand, the confirmation processing unit 113 ends the processing when there are no unprocessed procedures remaining.

*** Effect of Embodiment 6 ***
As described above, the data input device 10 according to the sixth embodiment uses the contents already input in the other procedures when performing the plurality of procedures in succession. As a result, the user does not have to fill in the same contents many times, and the labor of the procedure can be reduced as compared with the case where the procedure is performed using paper.

Embodiment 7.
The seventh embodiment is different from the first embodiment in that the handwriting is verified by the name or the like and the identity is confirmed. In the seventh embodiment, these different points will be described, and the same points will be omitted.
It is also possible to combine the seventh embodiment with the second to sixth embodiments.

*** Explanation of configuration ***
The configuration of the data input device 10 according to the seventh embodiment will be described with reference to FIG. 31.
The data input device 10 is different from the data input device 10 shown in FIG. 2 in that the handwriting appraisal unit 117 is provided as a functional component. The handwriting appraisal unit 117 is realized by software like other functional components. The handwriting appraisal unit 117 may be realized by hardware like other functional components.

*** Explanation of operation ***
The handwriting appraisal process according to the seventh embodiment will be described with reference to FIG. 32.
The processing of steps S111 to S115 is the same as the processing of steps S31 to S35 of FIG.

(Step S116 of FIG. 32: Handwriting appraisal processing)
The handwriting appraisal unit 117 performs handwriting appraisal based on the digital data and trail data written in the user information storage unit 53 of the database server 50 in step S114.
For example, when the handwriting appraisal unit 117 performs handwriting appraisal based on the name and telephone number handwritten by the user, the handwriting appraisal unit 117 identifies the name and telephone number of the same user handwritten in the past based on digital data. The handwriting appraisal unit 117 performs handwriting appraisal by comparing and determining the trail data of the specified name and telephone number and the trail data of the name and telephone number handwritten by the user this time.
The handwriting appraisal unit 117 ends the procedure for identity verification when it is determined that the characters have been handwritten by the same user by comparing the characters handwritten in the input field with the characters handwritten in the past.
On the other hand, if the handwriting appraisal unit 117 cannot confirm the handwriting by the same user as a result of the determination, the handwriting appraisal unit 117 notifies the clerk and asks the clerk to confirm the identity.

The determination by the handwriting appraisal unit 117 may be performed by, for example, either the name or the telephone number, or may be performed by the address or the like.

*** Effect of Embodiment 7 ***
As described above, the data input device 10 according to the seventh embodiment performs handwriting appraisal. As a result, face-to-face identification can be omitted in the operation of confirming that the person has completed the procedure after the input procedure is completed.

In addition, if identity verification is performed at the first stage of the input procedure, the characters entered in the input field 86 corresponding to the existing input contents by the user in the past procedure for the subsequent input procedures. It becomes possible to project as.

Embodiment 8.
The eighth embodiment is different from the first embodiment in that a keyword related to the application information uttered by the user is acquired and the natural language is recognized to display a list of procedures related to the keyword. In the eighth embodiment, these different points will be described, and the same points will be omitted.
It is also possible to combine the eighth embodiment with the second to seventh embodiments.

*** Explanation of configuration ***
The configuration of the data input system 1 according to the eighth embodiment will be described with reference to FIG. 33.
The data input system 1 is different from the data input system 1 shown in FIG. 1 in that it includes a voice input device 71 and a voice output device 72. The voice input device 71 is a microphone device for voice input. The voice output device 72 is a speaker device for transmitting voice data to the user.

The configuration of the data input device 10 according to the eighth embodiment will be described with reference to FIG. 34.
The data input device 10 is different from the data input device 10 shown in FIG. 2 in that it includes a natural language recognition unit 118 as a functional component. The natural language recognition unit 118 is realized by software like other functional components. The natural language recognition unit 118 may be realized by hardware like other functional components.
Further, the database server 50 realizes the function of the natural language storage unit 55.

*** Explanation of operation ***
The natural language recognition process according to the eighth embodiment will be described with reference to FIG. 35.
The processing of steps S123 to S125 is the same as the processing of steps S11 to S13 of FIG.

(Step S121 in FIG. 35: Purpose confirmation process)
The natural language recognition unit 118 acquires the voice emitted by the user. The acquired user's voice is stored in the natural language storage unit 55.
In order to have the user transmit the purpose of the visit by voice, the voice output device 72 may ask the purpose of the visit, or the user may be prompted to speak by a signboard or the like.

(Step S122 of FIG. 35: Procedure list generation process)
The natural language recognition unit 118 extracts characters as keywords from the acquired voice of the user and generates them as a list of procedures related to the keywords registered in advance.

Then, in step S123, the projection unit 111 displays the selection screen 81 showing the list of procedures generated in step S122 on the input table 40.

For example, as shown in FIG. 36, when the natural language recognition unit 118 extracts the keyword "moving" from the voice emitted by the user, the natural language recognition unit 118 displays a list displaying the procedures of "address change" and "account opening". Generate.

When the keyword cannot be recognized, or when the recognized keyword is a special keyword, a message prompting the user is displayed at the counter.

*** Effect of Embodiment 8 ***
As described above, the data input device 10 according to the eighth embodiment performs the natural language recognition process. The natural language recognition process makes it possible to display a list of necessary application procedures without human intervention by having the user who came to the office for the procedure utter the purpose of the visit by voice.
Depending on the procedural institution, there are many possible procedural items, and it often happens that you do not know which item to select, but you can save the trouble of searching.

Further, it may be configured to operate by inputting a keyword indicating the purpose of the visit without using voice recognition.

Embodiment 9.
The ninth embodiment is different from the first embodiment in that the data input device 10a is connected to another data input device 10b via a network, and the user and the remote operator share the projection screen. In the ninth embodiment, these different points will be described, and the same points will be omitted.
It is also possible to combine the ninth embodiment with the second to eighth embodiments.

*** Explanation of configuration ***
The configuration of the data input system 1 according to the ninth embodiment will be described with reference to FIG. 37.
The data input system 1 is different from the data input system 1 shown in FIG. 1 in that it includes an audio input device 71, an audio output device 72, and a television camera 73. The voice input device 71 is a microphone device for acquiring a user's voice. The voice output device 72 is a speaker device for transmitting voice data to the user. The TV camera 73 is an imaging device for acquiring a user's image.

The configuration of the data input device 10 according to the ninth embodiment will be described with reference to FIG. 38.
The data input device 10 is different from the data input device 10 shown in FIG. 2 in that the screen sharing unit 119 is provided as a functional component. The screen sharing unit 119 is realized by software like other functional components. The screen sharing unit 119 may be realized by hardware like other functional components.

*** Explanation of operation ***
The screen sharing process according to the ninth embodiment will be described with reference to FIG. 39.
Here, it is assumed that the data input device 10a and the data input device 10b are connected via a network, the data input device 10a is installed on the user side, and the data input device 10b is installed on the operator side.
The processing of step S132 and step S133 is the same as the processing of step S2 and step S3 of FIG.

(Step S131 in FIG. 39: Screen sharing process)
The projection unit 111 projects and displays the input format 84 in which the input contents 85 and the input field 86 are specified by the projector 20 on the input table 40 for the procedure selected by the user. Then, the screen sharing unit 119 transmits the input format 84 to the data input device 10b connected to the data input device 10a via the network. The projection unit of the data input device 10b projects and displays the transmitted input format 84 on the projection surface, and shares an image with the data input device 10.

In step S132, the locus and the recognized characters handwritten in the input field 86 on the data input device 10a side are transmitted to the data input device 10b and projected onto the projection surface by the projection unit of the data input device 10b. Will be done. Further, the locus and the recognized characters handwritten in the input field 86 on the data input device 10b side are transmitted to the data input device 10a and projected and displayed on the input table 40 by the projection unit 111 of the data input device 10. ..
That is, it is possible to input to the input field 86 on both the data input device 10a side and the data input device 10b side, and the input contents are shared by the data input device 10a and the data input device 10b.

For example, if the user writes "Tanaka" on the projection plane, it is displayed on the projection plane of a different data input device 10b at the same time as the description.
Further, when "Tanaka" is changed to "Suzuki" on the projection surface of the different data input device 10b, "Tanaka" written on the projection surface of the user is changed to "Suzuki" at the same time as the change.

*** Effect of Embodiment 9 ***
As described above, the data input device 10a according to the ninth embodiment performs the screen sharing process. As a result, by handling the different data input devices 10b by the operator, not only the explanation using the voice input device 71, the voice output device 72, and the TV camera 73 but also handwriting is performed for the user who does not know how to write the procedure documents. It becomes possible to give an explanation.

In the operation of writing on behalf of the user, it is possible to respond even if the operator is not present.

1 data input system, 10 data input device, 11 processor, 12 memory, 13 storage, 14 communication interface, 15 processing circuit, 111 projection unit, 112 data recognition unit, 113 confirmation processing unit, 114 statistics unit, 115 placement determination unit, 116 Display area recognition unit, 20 Projector, 21 Projection surface, 30 Electronic pen, 40 Input stand, 50 Database server, 60 Transmission path, 70 Imaging device, 81 Selection screen, 82 Display contents, 83 List, 84 Input format, 85 Input Contents, 86 input fields, 87 procedure document formats, 88 confirmation data, 89 reference information.

Claims (5)

A display area recognition unit that recognizes the size of the top surface of the input stand,
A projection unit that projects display content according to the size recognized by the display area recognition unit and includes an input format indicating an input content and an input field onto the input table.
A data input device including a data recognition unit that recognizes handwritten characters in the input field of the input format projected and displayed by the projection unit. The data input device according to claim 1, wherein the projection unit has a size corresponding to the size and projects and displays the display content on the input table. The data input device according to claim 1 or 2 , wherein the projection unit projects and displays other display contents in addition to the input format when the size is larger than the reference. The display area recognition unit recognizes the size of the upper surface of the input stand and
The projection unit projects and displays the display content according to the recognized size , including the input content and the input format indicating the input field , on the input table.
Data input method data recognizing unit, recognizing handwritten characters in the input field of the input format which is projected and displayed. Display area recognition processing that recognizes the size of the top surface of the input stand,
The projection process of projecting the display content according to the size recognized by the display area recognition process and including the input format indicating the input content and the input field onto the input table.
A data input program that causes a computer to function as a data input device that performs a data recognition process for recognizing characters handwritten in the input field of the input format projected and displayed by the projection process.

Images