JP2003187242A - System and method for inputting data - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method and a system, etc., for inputting data having a structure for enabling sharing of inputted information between dialogists performing different input works in dialog including image information to be performed between remote places via a prescribed transmission means. <P>SOLUTION: A data editing means (26A) successively composites pieces of media data with the same contents as that of a sheet-like medium (800A) recorded in a database (265) and pieces of handwritten inputted information as information directly written in the sheet-like medium (800A) and fetched via input means (500A, 700A) based on pieces of inputted position information in the sheet-like medium. The sharing of the inputted information between each dialogist is enabled by mutually confirming this synthetic data via the transmission means (27) by each dialogist. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention enables sharing of input information between interlocutors who are performing different input operations in a dialogue including image information which is performed between remote places via a predetermined transmission means. The present invention relates to a data input method and a data input system having a structure.

[0002]

2. Description of the Related Art In recent years, a remote learning mode has been established between a teacher and one or more students between remote areas via transmission means such as English conversation and supplementary training. In such distance learning, the teacher and the student proceed with the learning while watching the image of the interlocutor. Therefore, for example, it is suitable for the distance learning performed through the transmission means disclosed in Japanese Patent No. 3074677. An interactive system is known.

On the other hand, in distance learning as described above,
Teachers need to provide students with additional information such as presentation of tasks, scoring, and evaluation. For example, Japanese Patent No. 2970
As disclosed in Japanese Patent No. 661, there has been proposed a display method capable of presenting not only the image of the interlocutor but also various related information.

[0004]

As a result of detailed observation of the input action by each interlocutor, for example, the teacher side and the student side, when the dialogue such as learning is carried out via the video as described above. , Found the following issues. That is, in psychological counseling for problems such as school refusal, unemployment, and suicide, it is important to build a closer relationship by maintaining a line of sight between the interlocutors (counselor and client). Is becoming. On the other hand, it has been confirmed that there is a clear difference in the input action between the teacher side and the student side in distance learning and the like, and it is not always important to maintain the line-of-sight matching state during such input action.

[0005] Specifically, on the student side, in carrying out a task (answer of an exercise, etc.), a pencil writing, a ballpoint pen, or ink is used for paper while watching the display at hand, rather than inputting with the mouse or pen while watching the computer monitor. It is easier to write directly on a sheet-shaped medium such as. Also,
An input method using a touch pen on a liquid crystal board has been proposed, but the device itself is expensive, the writing feeling of a pencil writing or a ballpoint pen is inferior to a sheet-like medium such as paper, and recording is left on the spot. However, there are some inconveniences such as not being able to secure a sufficient display area on the monitor on the assumption that a remote image is displayed, or requiring a separate monitor for displaying the image of the interlocutor.

On the other hand, it is preferable that the teacher inputs the same monitor while looking at the facial expression of the student when he or she discusses the problem or the like provided to the student.

The present invention has been made in order to solve the above-mentioned problems, and in a dialogue including image information which is performed between remote places via a predetermined transmission means, a dialogue in which different input works are performed. An object of the present invention is to provide a data input method, a data input system, a computer program for executing the data input method, and a recording medium having the computer program recorded therein, the data input method having a structure that enables sharing of input information between persons.

[0008]

A data input method and a data input system according to the present invention are different from each other in one-to-one or one-to-many remote learning performed between a teacher and one or more students. Even in a two-way interactive system in which work is performed, that is, a two-way interactive system that allows a state where the eyes do not agree with each other during a dialog, it is possible to share input information among participants.

Specifically, the data input system according to the present invention comprises at least a database, input means, and editing means. The database stores a plurality of types of electronic medium data, and the electronic medium data is a sheet-shaped medium such as paper or a transparent film, which is handed to one of the interlocutors, on which predetermined disclosure contents are printed. It is the digitized data of the same content as. Note that the sheet-shaped medium on which the predetermined disclosure content (for example, a problem or the like) is printed is a sheet that is handed to one of the interlocutors (for example, a student) in advance,
It may be a paper on which the media data distributed via the transmission means is printed out by the one interlocutor. Further, the input means sequentially takes in the handwritten input information directly written on the sheet medium by the one interlocutor as digitized data together with the input position information on the sheet medium.
The editing means synthesizes the digitized medium data read from the database and the handwritten input information fetched from the input means on the basis of the input position information to sequentially generate new edited data. It is possible for the interlocutors to share the input information by confirming the edited data thus synthesized by each interlocutor.

The data input system according to the present invention preferably further comprises display means for displaying the edited data combined by the editing means in a predetermined area on the monitor screen. This is because each interlocutor can successively confirm the input contents.

Further, in the database, one or more multimedia data (handwritten characters, keyboard input characters, voices, etc.) linked in advance to the digitized medium data in order to enable presentation of various related information during the dialogue. Etc. are preferably stored.

The data input system having the above structure realizes the data input method according to the present invention.

The data input method as described above may be a program executed by a computer or the like,
In this case, the program may be distributed via a network regardless of whether it is wired or wireless.
It may be stored in a recording medium such as D or a flash memory.

[0014]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of a data input method and a data input system according to the present invention will be described in detail below with reference to FIGS. In the description of the drawings, the same parts will be denoted by the same reference numerals and redundant description will be omitted.

The data input method and data input system according to the present invention enable effective dialogue progress in a bidirectional interactive system in which different input operations are performed. The description will be centered on the case where it is applied to the one-to-one or one-to-many distance learning performed between a student and one or more students.

FIG. 1 is a conceptual diagram for explaining an embodiment (an example of distance learning) of a data input method according to the present invention. Further, for example, the technique described in Japanese Patent No. 30744677 can be applied to the two-way interactive system shown in FIG.

In the interactive system of FIG. 1, the student side terminal has an input pen 700A as an input means, a tablet 500A on which a sheet-like medium such as paper or a transparent film is set as a question sheet, and a display means. Monitor 21A, data processing device 26A including editing means for synthesizing digitized data, CCD installed on monitor 21A
An imaging device 600A that captures the image of the student (first interlocutor) 3A with the camera 5A is provided. On the other hand, the teacher terminal
A tablet 500B on which an input pen 700B as an input means and a question paper (paper medium) are installed, a monitor 21B as a display means, a data processing device 26B including an editing means for combining electronic data, and a monitor 21B. An image pickup device 600B for capturing an image of the teacher (second interlocutor) 3B by the CCD camera 5B is provided. The student-side terminal and the teacher-side terminal are connected via the transmission means 27. Here, the transmission means 27 enables transmission and reception of image information and audio information between the student side terminal and the teacher side terminal, so that an optical fiber transmission line (main transmission line) and a satellite that enable large capacity transmission. It includes communication transmission lines (backup transmission lines) and the like. The transmission means 27 may be wired or wireless, includes an already laid network such as a telephone network, and further has an electronic bulletin board system (BBS: Bulletin Board Syste).
m) is also included.

Normally, in distance learning, the teacher 3B confirms the state of the student 3A and sends out advice while the student 3A is filling in the answer sheet kept at hand as shown in FIG. Such scenes often occur. In this case, teacher 3
In B, the state of the imaging area CA1 of the CCD camera 5A (the expression of the student 3A who is looking at the area PA1) is displayed on the monitor 21B. On the other hand, the monitor 21A of the student terminal
Shows the state of the imaging area CA2 of the CCD camera 5B (the teacher 3B who is looking at the area PA2 including the monitor screen).
Expression) is displayed on the monitor 21A. Even in a two-way interactive system in which different input operations are performed in this way, that is, in which a mutual line-of-sight does not match during a dialog, the data input method and the data input system can be used by the interlocutors. Enables information sharing.

FIG. 2 is a diagram for conceptually explaining the schematic operation of the data input system which realizes the data input method in the bidirectional interactive system of FIG. 1 which enables the above-described interactive form. is there.

In the data input system, the data processing device 26A of the student side terminal stores the teaching material data (electronic medium data stored corresponding to a sheet medium such as question paper provided to the student) in advance. The digitized data sequentially fetched is combined with the digitized medium data 820A read from the teaching material database 265A and corresponding to the paper medium actually set on the tablet 500A at hand of the student 3A. Here, the digitized data to be combined with the digitized medium data 820A is stored in the character information etc. written by the student 3A itself on a sheet (for example, a question sheet) actually set on the tablet 500A and the transmission means 27. It includes related data such as explanations and answers from the teacher 3B transmitted via the above. In this way, the electronic medium data 820A and the electronic data 810A sequentially fetched,
The edited data combined with 810B is sequentially displayed on the monitor 21A of the student terminal. On the other hand, also in the data processing device 26B of the teacher side terminal, the computerized medium data 820B read from the teaching material database 265B and the computerized data fetched from the tablet 500B, the keyboard, the touch panel, etc. (input information from the teacher 3B) 810B
The edited data in which the digitized data 810A transmitted from the student side terminal via the transmitting means 27 is combined is sequentially displayed on the monitor 21B of the teacher side terminal.

In this way, the student side terminal and the teacher side terminal sequentially exchange input data with each other while updating the common editing data, so that the students 3A and 3
It becomes possible for B to share the input information with each other.

FIG. 3 is a diagram showing a schematic configuration of the data input system according to the present invention. The data input system is the data processing device 26A, 26 shown in FIGS.
A data processing device 26 as an editing means corresponding to B;
A monitor 21 as a display unit, a tablet 500 and an input pen 700 as an input unit are provided.

The data processing device 26 as an editing means.
Is a data input / output unit 261, an input unit (500, 700) or C for exchanging data via the transmission unit 27.
External recording device 900 such as D, DVD, and flash memory
Data input / output unit 263 for exchanging data with the student 3A
And a control unit for synthesizing edit data common to the teacher 3B, a drawing unit 264 for displaying the edit data synthesized according to the display instruction of the control unit 262 on the monitor 21, a paper actually set on the tablet 700, and the like. Teaching material database 26 in which image data of on-sheet medium 800 is stored
5, and a learning history database 266 in which learning history data for each student is stored.

In the teaching material database 265, hint data for tasks and further commentary data are linked to each digitized medium data for each digitized medium data (identified by the teaching material No.) corresponding to each paper teaching material. It is stored in the state.

More specifically, as shown in FIG.
Paper materials (on-sheet media with question and answer sections printed)
800 is delivered to the student in advance (this paper teaching material may be printed out at the student side terminal via the transmission means 27). This paper teaching material is set at a predetermined position on the tablet 500, as shown in FIG. The paper teaching material 800 may be fixed to the tablet 500 mechanically (clip, sheet scissors, etc.), or may be fixed by using an adhesive that is electrostatically fixed or removable.

In FIG. 5B, 801 and 802 are
It is an alignment mark for specifying the relative position of the paper medium 800 on the tablet (position information is sent to the data device 26 by touching these alignment marks with the input pen 700). Data processing device 26
On the side, coordinate conversion is performed on the monitor screen 8a based on the input position information, and the coordinates of the displayed electronic teaching material image 10 and the actual paper medium 800 are matched. Further, as shown in FIG. 5A, the monitor screen 8
Image a of electronic teaching material corresponding to the paper medium 800 is shown on a.
In addition to 0, the image 9 of the teacher is taught in a state where it partially overlaps with the CCD camera 5 so that the line of sight can be matched between the student 3A and the teacher 3B at any time.

In the data processing device 26, the paper teaching material 80
Digitized medium data corresponding to 0 is the teaching material database 26.
5 and is displayed on the monitor screen 8a as shown in FIG. 5 (a). The paper medium 800 actually installed on the tablet 500 and the digitized medium data to be displayed are identified by the teaching material number 803 printed on the paper medium 800 (indicating the electronic teaching material image 10 on the monitor screen 8a). To be done. Further, in the electronic teaching material image 10 displayed on the monitor screen 8a, a hint button 10a is also displayed to enable calling of related data stored in the teaching material database 265 (hint calling by clicking with the cursor). Instructions are possible).

At this time, since the question sentence (paper medium 800) presented to the student 3A corresponds to the displayed electronic teaching material image 10, the student 3A uses the tablet 50.
Writing is performed on the paper medium 800 installed on the computer 0 using a computer input pen (for example, an electromagnetic induction system) equipped with a ballpoint pen, ink, pencil, or the like. As such an input means, for example, there is a tablet device manufactured by Wacom Co., Ltd. This allows the student 3A to indirectly add data to the digitized medium data via writing on the paper medium 800 (simultaneous erasing can be achieved by adding an eraser function to the reverse end of the input pen 700). Is also possible). By using such a tablet device as an input interface, writing on a paper teaching material (paper medium 800) and data composition on electronic medium data can be performed at the same time. If such combination of image data is sequentially performed, the paper medium 8 at hand is handy at the student terminal.
On the other hand, the teacher terminal can confirm the information input by the student 3A via the terminal monitor 21B. It is possible to overwrite the text and share the input information of each person.

Next, the data input method according to the present invention, particularly the input operation in the student side terminal will be described with reference to the flowchart of FIG.

First, the student 3A sets the question paper (paper medium 800A) that has been delivered or printed out in advance at a predetermined position on the tablet 500A in its own terminal (step ST10). At this time, the correspondence between the coordinates on the question paper and the coordinates of the electronic teaching material image (electronic medium data read from the teaching material database 265) displayed on the corresponding monitor screen corresponds to the alignment printed on the question paper. This is performed by specifying the position of the mark on the tablet 500A.

When the setting of the question paper on the tablet 500A is completed, the data processing device 26 waits in a state of accepting data input from the student (step ST20).
This data input may be input from the tablet 500A using the input pen 700A or input from the keyboard or mouse, but in the case of input from the tablet 500A, information once input (electronic data Based on the input position information sent together with the input information, the coordinates of) are subjected to coordinate conversion so as to match the coordinates on the monitor screen once (step ST50).

Then, the control unit 262 controls the database 2
Computerized media data read from 65 and tablet 5
The electronic data generated based on the input information from 00A is combined to generate new edited data (new electronic teaching material image). Then, the control unit 262 instructs the drawing unit 264 to display the edited data thus obtained on the monitor. It should be noted that this combining and displaying operation is sequentially performed when there is a tablet input (step ST70).

On the other hand, the tablet input data in the student side terminal is also sent to the teacher side terminal via the transmission means 27, and the teacher side terminal also receives the digitized medium data read from the teaching material database. The teacher 3B itself can confirm the edited data combined with the tablet input information via the monitor 21B. When presenting a comment or answer to the student 3A from the teacher 3B during this confirmation (interruption processing) (step ST30),
In the student terminal, new edit data is generated by the above-described synthesizing process (step ST50) and the obtained edit data is displayed (step ST60).

By performing such steps until the end of learning (step ST70), the input information can be shared between the student 3A and the teacher 3B who are performing different input work.

Further, since the student 3A can input data via the display on the monitor 21A, when the problem is not understood, the hint button displayed on the paper medium 800A or the monitor screen is clicked. By clicking
The hint message can be displayed in the media image on the monitor screen or in another window. For example, in the study of mathematics, a hint message “Use that the sum of the triangular cabinet is 180 °”, a formula, etc. are displayed. For learning English, as shown in FIG. 7, by highlighting an unknown English word, linking a hint message such as “book in this case is reserved” with word data. , It becomes possible to display related information in a timely manner. The student 3A can easily learn by seeing such a display. Further, if these display contents are sequentially stored in the learning history database 266, it is possible to use them for reviewing the student 3A. For example, the monitor screen 8b shown in FIG.
The image 9 of the teacher 3B and the electronic teaching material image 20 are displayed so as to partially overlap the camera 5. Further, a reverse display 20a for pointing out a term unknown to the student 3A is superimposed on the electronic teaching material image 20, and a window 20b for displaying a commentary message is also superimposed on the electronic teaching material image 20.

Further, by monitoring the entry status of the student 3A in the answer section of the paper medium 800A (the progress data is sequentially stored in the learning history database 266), the learning progress of the student 3A can be calculated by the computer. You can check sequentially. In particular, when one teacher remotely teaches a plurality of students, as shown in FIG. 8, by displaying the progress graph and the number of times the hint is clicked in real time, it is effective for the teacher 3B to provide individual guidance. It can be information. For example, when the student B having the slowest progress in the progress graph is designated (clicked) on the monitor screen, the image and the entry information of the student B are displayed in a window, and the teacher 3B becomes able to give individual instruction to the student B. A message can be input to the student B from the teacher 3B side. It is more preferable that the color of the progress graph is changed once the individual guidance is given, and the cumulative number of times of intervention and time are also displayed. Further, the question occurrence from the student side may be confirmed, for example, by blinking a progress graph (when the number of questions is large, the questions may be rearranged in order of application and displayed). If the number of students is about 2 to 5, it is also effective to reduce the display contents (composite data including digitized medium data) of each student on the monitor screen of the teacher side terminal. As a result, the teacher 3B can directly monitor the progress of each student and can utilize it for confirmation of the timing of individual instruction. Furthermore, if the answer format of the question to be presented to the students is selected or the handwriting character recognition function is added to the data input system, automatic scoring and correctness rate progress graph can be displayed.

In the data input method and system according to the present invention, the sheet-like medium such as paper or transparent film is linked with the digitized data as described above, so that the conventional pencil or ballpoint pen can be used as the input work on the student side. It is possible to simultaneously input the digitized data itself together with writing the marker. On the other hand, the teacher can teach while watching the students' facial expressions (message input, voice input, etc.),
It becomes easy to monitor the degree of understanding of the student through the facial expression of the student. Even when there are multiple students, it is easy to grasp the timing of individual instruction. In this way, in the data input method and system, since the input work on the student side is recorded as both paper teaching materials and electronic teaching materials, the student side is required to review.
Teachers can use it extensively as reference data for educational analysis and next instruction.

[0038]

As described above, according to the present invention, the medium data having the same contents as the sheet medium previously recorded in the database and the information directly written on the sheet medium and the input means such as a tablet are used. The handwritten input information captured via the is sequentially synthesized based on the input position information on the sheet-shaped medium. With this configuration, there is an effect that it becomes possible to share the input information between the interlocutors who are performing different input work in the dialog in which the image information is transmitted and received between the remote places through the predetermined transmission means.

[Brief description of drawings]

FIG. 1 is a conceptual diagram for explaining an embodiment (an example of distance learning in a two-way interactive system) of a data input method according to the present invention.

FIG. 2 is a diagram conceptually illustrating a schematic operation of a data input system that realizes the data input method shown in FIG.

FIG. 3 is a diagram showing a schematic configuration of a data input system according to the present invention.

FIG. 4 is a data table for explaining a logical structure of a teaching material database.

FIG. 5 shows an example of a data display in remote learning using the data input system according to the present invention and an example of an input means for fetching handwritten input information and input position information.

FIG. 6 is a flowchart for explaining the operation of the data input method according to the present invention.

FIG. 7 is a diagram showing another example of data display in distance learning using the data input system according to the present invention.

FIG. 8 is a diagram showing still another data display example in distance learning using the data input system according to the present invention.

[Explanation of symbols]

5 (5A, 5B) ... CCD camera, 21, (21A, 2
1B) ... Display device (monitor), 26 (26A, 26B)
... data processing device (data editing means), 27 ... transmission means, 262 ... control means, 264 ... drawing section, 265 ... teaching material D / B, 266 ... learning history D / B, 500 (500A,
500B) ... Tablet (input means), 700 (700
a, 700b) ... Input pen (input means), 800 (80
0A, 800B) ... paper (sheet medium), 900 ... external recording medium.

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 7/14 H04N 7/14 5E501 F term (reference) 2C028 AA03 BA04 BB04 BC01 BD02 CA12 CA13 5B050 AA08 BA06 BA10 BA18 BA20 CA05 CA07 DA09 EA19 EA20 FA02 FA09 FA19 GA08 5B057 AA20 BA19 CE08 DA16 5C064 AA01 AA06 AC05 AC13 AC18 5C076 AA15 AA16 AA19 AA25 CA02 CA04 5E501 AA02 AB20 BA05 CA02 CC04 EB11 FA14

Claims (8)

[Claims] 1. A database in which digitized medium data having the same content as that of a sheet medium on which predetermined disclosure contents are printed and a handwritten input information directly written on the sheet medium are stored in the sheet medium. Input means for sequentially fetching digitized data together with input position information, and handwritten input information fetched from the input means with respect to the digitized medium data read from the database, based on the input position information Then, the data input system is provided with an editing means for sequentially generating new edit data. 2. The data input system according to claim 1, further comprising display means for displaying the edited data synthesized by the editing means in a predetermined area on a monitor screen. 3. The database stores one or more multimedia data linked to the computerized media data.
Data entry system described. 4. A sheet on which different contents are printed, while handwritten input information directly written on a sheet medium on which predetermined disclosure contents are printed is taken in as electronic data together with input position information on the sheet medium. Electronic medium data having the same content as the sheet medium selected from the sheet medium is read from the database in which electronic medium data prepared corresponding to each sheet medium is stored, and is read from the database. Data for sequentially generating new edited data by synthesizing the handwritten input information captured as electronic data with the computerized medium data based on the input position information captured together with the handwritten input information. input method. 5. The data input method according to claim 4, wherein the newly generated edit data is displayed in a predetermined area on a monitor. 6. The database stores one or more multimedia data linked to the computerized media data.
The data entry method described. 7. A computer program that causes a computer to execute the method according to claim 4. 8. An external recording medium having a computer program recorded thereon for causing a computer to execute the method according to any one of claims 4 to 6.