JP4360547B2 - Interactive data communication system using digital pen input device - Google Patents

Description

  The present invention uses a digital pen input device capable of inputting data handwritten on a sheet as electronic data to a computer, between a transmitting terminal device and a receiving terminal device connected to each other via a communication network. The present invention relates to a data communication system capable of transmitting and receiving data.

  In recent years, pen-type input devices called “digital pens” (also called “electronic pens” etc.) have become widespread. The digital pen input device includes a dedicated pen and a writing data output unit that holds a sheet, detects a writing operation by the dedicated pen on the sheet, and outputs the writing data. The data handwritten on the paper using a dedicated pen by the user can be input to the computer as electronic data very easily.

A system has been proposed that simplifies the input operation of data to be transmitted by using this digital pen input device when data communication is performed between two terminal devices interconnected via the Internet. Has been. As an example of such a system, there is one that uses a digital pen input device in a distance learning teaching system using the Internet, which simplifies data input when answering exercises and correcting them. (For example, refer to Patent Documents 1 and 2).

In the distance learning instruction system using this conventional digital pen input device, the teacher side and the student side hold a common problem paper (writing paper) in the writing data output part of each digital pen input device, Moreover, the screen of the common problem paper is displayed on both displays, and data is transmitted and received between the lecturer side and the student side by handwriting input on the common problem paper with a dedicated pen. It was.

  By the way, in the actual correction instruction, when the student asks a question, the student holds a specific page in the teaching material on which the question to be asked is posted in the writing data output unit of the digital pen input device. While it is convenient to use it to receive instructor's correction instruction, the instructor holds an enlarged print of only the part of the problem that should be corrected in the writing data output part of the digital pen input device. It is convenient to use it to give corrective guidance to students.

  That is, in general, in the correction instruction, it is advantageous that the size of the problem paper provided in the digital pen input device on the instructor side is different from the size of the problem paper provided in the digital pen input device on the student side. However, the conventional distance learning instruction system cannot cope with such a situation.

JP 2003-345232 A JP 2004-145247 A

  Accordingly, an object of the present invention is to be provided in a digital pen on a transmission side and a reception side when performing bidirectional data communication using a digital pen input device between terminal devices connected to each other via a communication network. An object of the present invention is to enable smooth data transmission / reception even when the paper sizes are different from each other.

  In order to solve the above-mentioned problem, the present invention is a bidirectional data communication system using a digital pen input device, and includes a transmission-side terminal device and a reception-side terminal device connected to each other via a communication network, The transmission side terminal device includes an image input unit for inputting image data of the first sheet, a first transmission side data transmission unit for transmitting the image data of the first sheet to the reception side terminal device, The receiving terminal device has a data receiving unit for receiving data from the calling terminal device and a receiving video memory, and when image data is stored in the receiving video memory, A receiving side display unit for displaying, a first receiving side image display unit for storing image data of the first sheet from the transmitting side terminal device in the receiving side video memory, and the receiving side An image editing unit for trimming an image part from the image on the first sheet displayed on the display unit and incorporating an alignment mark in the image part, and an image of the edited image A first incoming memory that stores data, a second incoming image display unit that stores the edited image in the incoming video memory, and the edited image based on position data of the alignment mark. An incoming-side reference coordinate system setting unit that sets a reference xy coordinate system on the first incoming-side data transmission unit that sends image data of the edited image to the outgoing-side terminal device; The transmitting terminal device further includes a data receiving unit that receives data from the receiving terminal device, and a first transmitting side memo that stores image data of the edited image from the receiving terminal device. A transmission-side reference coordinate system setting unit that sets a reference xy coordinate system on the edited image based on the position data of the alignment mark, and a transmission-side video memory. When image data is stored, a transmission side display unit that displays the image, a first transmission side image display unit that stores image data of the edited image in the transmission side video memory, and transmission side digital pen input And a writing data output for detecting the writing operation by the dedicated pen on the first paper, and outputting the writing data. And the writing data output unit uses the dedicated pen to display the edited image displayed on the transmission side display unit on the first sheet. When a point corresponding to the alignment mark is designated, a first xy coordinate system is set on the first sheet based on the point, and the writing data is output together with the coordinates in the first xy coordinate system. Further, the coordinates of the point in the first xy coordinate system are output, and the transmitting side terminal device further outputs the coordinates of the point in the first xy coordinate system on the first sheet. Based on the coordinates and coordinates of the alignment mark in the reference xy coordinate system on the edited image, the x-axis and y-axis between the first xy coordinate system and the reference xy coordinate system Determining an enlargement / reduction ratio and converting coordinates in the first xy coordinate system of handwritten data from the transmission-side digital pen input device into coordinates in the reference xy coordinate system A transmission-side writing data conversion unit that converts the writing data into data in the reference xy coordinate system; and a second transmission-side memory that stores the writing data converted by the transmission-side writing data conversion unit; A second transmission side data transmission unit that transmits the writing data converted by the transmission side writing data conversion unit to the reception side terminal device, and the reception side terminal device further includes the transmission side terminal device A second incoming-side memory in which handwritten data is stored, and an incoming-side digital pen input device, the incoming-side digital pen input device holding a dedicated pen and a second sheet thereon A writing data output unit for detecting a writing operation by the dedicated pen and outputting the writing data. The writing data output unit is placed on the second sheet by the dedicated pen. When a point corresponding to the alignment mark in the edited image displayed on the incoming display unit is designated, a second xy coordinate system is set on the second paper based on the point, The writing data is output together with the coordinates in the second xy coordinate system, and further the coordinates of the point in the second xy coordinate system are output. Based on the coordinates of the point in the second xy coordinate system on the second sheet and the coordinates of the alignment mark in the reference xy coordinate system on the edited image, the second xy coordinate system And an enlargement / reduction ratio of the x-axis and y-axis between the reference xy coordinate system and the second xy coordinate system of writing data from the incoming digital pen input device. By converting the writing data into data in the reference xy coordinate system by converting the coordinates into the reference xy coordinate system, and the incoming writing data conversion unit. A third incoming-side memory that stores the converted writing data; a second incoming-side data transmission unit that transmits the writing data converted by the incoming-side writing data conversion unit to the outgoing-side terminal device; and Each time new writing data is stored in the second or third incoming memory, the data stored in the second and third incoming memories is replaced with the data stored in the first incoming memory. And a third called-side image table that stores the data in the first called-side memory and the called-side video memory and clears the data stored in the second and third called-side memories. The caller terminal device further includes a third caller memory in which writing data from the callee terminal device is stored, and a new writing in the second or third caller memory. Each time data is stored, the data stored in the second and third caller memories is combined with the data stored in the first caller memory and is combined with the first caller memory. And a second transmission side image display unit that clears data stored in the second and third transmission side memories and stored in the transmission side video memory. A data communication system is configured.

According to a preferred embodiment of the present invention, the alignment mark incorporated in the edited image is two vertices located on a diagonal line of a selected rectangular frame portion in the edited image.
According to another preferred embodiment of the present invention, the transmitting terminal device includes a FAX device instead of the image input unit and the first transmitting data transmitter, and the bidirectional data communication system further includes: A mail server connected to the Internet and connected to the FAX apparatus via a public telephone network, and the mail server receives the image data of the first sheet received from the FAX apparatus as an e-mail The file is attached to the destination terminal device and transmitted to the destination terminal device. When the electronic mail is received by the data receiving unit of the destination terminal device, the first incoming image display unit displays the electronic mail. The image data of the first paper attached to the mail as a file is stored in the incoming video memory.

  According to the present invention, a common screen is displayed on each of the display units on the caller side and the callee side, and an alignment mark is incorporated in the image on the screen. The point corresponding to the alignment mark on the display screen on the paper provided for the input device is specified, and on the digital pen input device paper based on the alignment mark coordinate on the display screen and the coordinate of the point on the paper. Since the data written on the screen is converted into the data on the display screen, smooth data transmission / reception can be performed even if the size of the paper provided in the digital pen input device is different between the calling side and the receiving side.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a block diagram showing a configuration of a bidirectional data communication system using a digital pen input device according to an embodiment of the present invention. In this embodiment, the system of the present invention takes the form of a distance learning instruction system. However, the configuration of the present invention is not limited to this embodiment, and the systems of the present invention mutually connect digital pen input devices. Needless to say, it can take the form of various systems that perform bidirectional data communication.

As shown in FIG. 1, the system of the present invention includes a transmitting terminal device 1 and a receiving terminal device 2 connected to each other via the Internet 3. The transmission side terminal device 1 and the reception side terminal device 2 include a transmission side digital pen input device 4 and a reception side digital pen input device 5, respectively.

  FIG. 2 is a block diagram showing the configuration of the transmitting terminal device, and FIG. 3 is a block diagram showing the configuration of the receiving terminal device. Referring to FIG. 2 and FIG. 3, the transmitting terminal device 1 receives an image input unit 14 for inputting image data of the first paper and the image data of the first paper to the receiving terminal device 2. A first transmission side data transmission unit 15 for transmission is provided. In this embodiment, the image input unit 14 is a scanner.

In this embodiment, the transmission of the first image data from the transmission-side terminal device 1 to the reception-side terminal device 2 is performed by the image input unit 14 provided in the transmission-side terminal device 1 and the first transmission-side data transmission. According to another preferred embodiment of the present invention, the originating terminal device 1 includes the FAX device 6 in place of the image input unit 14 and the first originating data transmission unit 15. It is done. Furthermore, a mail server 8 connected to the FAX apparatus 6 via the public telephone network 7 is provided.
Then, the mail server 8 attaches the image data of the first sheet received from the FAX apparatus 6 to the e-mail and sends it to the terminal device 2 on the receiving side.

  FIG. 4 is a plan view showing an example of the first sheet. In FIG. 4, the first sheet 50 is a problem sheet being used by the student. In FIG. 4, only the part necessary for the description is shown surrounded by a one-dot chain line.

The incoming side terminal device 2 includes a data receiving unit 30 that receives data from the outgoing side terminal device 1 and an incoming side display unit 32. The incoming-side display unit 32 includes an incoming-side video memory 33. When image data is stored in the incoming-side video memory 33, the incoming-side display unit 32 displays the image on the screen.

The incoming terminal device 2 is also provided with a first incoming image display unit 31 that stores the image data of the first paper 50 from the outgoing terminal device 1 in the incoming video memory 33. When the data receiving unit 30 of the receiving terminal device 2 receives an e-mail with the first paper image data attached as a file, the first receiving image display unit 31 attaches the file to the e-mail. The image data of the first paper 50 is stored in the incoming video memory 33.
Further, an image editing unit 34 for generating an edited image by trimming an image portion from the image of the first sheet 50 displayed on the receiving side display unit 32 and incorporating an alignment mark in the image portion. Provided. The trimming of the image portion and the incorporation of the alignment mark are performed by using an input means such as a pointing device such as a mouse or a keyboard according to a known digital image editing method.

The image data of the edited image is stored in the first incoming side memory 37 and is also stored in the incoming side video memory 33 by the second incoming side image display unit 36, and the edited image is stored in the incoming side display unit 32. Is displayed.

  FIG. 5 is a diagram showing the edited image generated by the image editing unit 34 and displayed on the screen of the receiving side display unit 32. Referring to FIG. 5, alignment marks 51a and 51b are incorporated in the edited image. In this embodiment, the alignment marks 51a and 51b are composed of two vertices placed on the diagonal line of the selected rectangular frame portion in the edited image.

Further, the receiving terminal device 2 is provided with a receiving reference coordinate system setting unit 40 that sets a reference xy coordinate system on the edited image based on the position data of the alignment mark. In this embodiment, the coordinate origin of the reference xy coordinate system is set at the position of the upper left mark 51a of the pair of alignment marks 51a and 51b, and the x coordinate and the y coordinate are set in units of pixels.
The image data of the edited image is transmitted to the transmitting terminal device 1 by the first incoming data transmission unit 35.

The transmission-side terminal device 1 further includes a data reception unit 10 that receives data from the reception-side terminal device 2 and a first transmission-side memory 18 that stores image data of the edited image from the reception-side terminal device 2. And a transmission-side reference coordinate system setting unit 16 that sets a reference xy coordinate system on the edited image based on the position data of the alignment mark. The outgoing side reference coordinate system setting unit 16 operates in the same manner as the incoming side reference coordinate setting unit 40.

In addition, the transmission side terminal device 1 includes a transmission side display unit 12. The transmission-side display unit 12 has a transmission-side video memory 13, and when image data is stored in the transmission-side video memory 13, the image is displayed on the screen.
The image data of the edited image from the receiving terminal device 2 is stored in the transmitting video memory 13 by the first transmitting image display unit 11, and the edited image is displayed on the transmitting display unit 12. On the outgoing side display unit 12, an edited image similar to that displayed on the incoming side display unit 32 is displayed (see FIG. 5).

The transmission-side digital pen input device 4 has a dedicated pen 21 and a writing data output unit 22 that holds the first paper 50, detects a writing operation by the dedicated pen 21 on the first paper 50, and outputs the writing data. ing.
When the point corresponding to the alignment marks 51a and 51b in the edited image displayed on the transmission side display unit 12 is designated on the first paper 50 by the dedicated pen 21, the writing data output unit 22 is designated. Based on this, the first xy coordinate system is set on the first sheet, the handwritten data is output together with the coordinates in the first xy coordinate system, and the coordinates of the point in the first xy coordinate system are output. This operation of the writing data output unit 22 will be specifically described with reference to FIG.

FIG. 7 is a diagram illustrating a state in which the first paper 50 is held in the writing data output unit 22 of the transmission-side digital pen input device 4. Referring to FIG. 7, on the first paper 50, points 54 a and 54 b corresponding to the alignment marks 51 a and 51 b on the screen of the transmission side display unit 12 are designated by the dedicated pen 21. At this time, the upper left point 54a
The coordinate origin of the first xy coordinate system is set at the position x, and the x coordinate and the y coordinate are set in dot units. And the writing data output part 22 outputs the coordinate in the 1st xy coordinate system of these points 54a and 54b. Thereafter, each time writing is performed with the dedicated pen 21, the writing data is output together with the coordinates in the first xy coordinate system.

The transmission side terminal device 1 is further provided with a transmission side writing data conversion unit 23. Based on the coordinates of the point in the first xy coordinate system on the first paper 50 and the coordinates of the alignment mark in the reference xy coordinate system on the edited image, the transmission side handwritten data conversion unit 23 -Determines the enlargement / reduction ratio of the x-axis and y-axis between the y-coordinate system and the reference xy coordinate system, and sets the coordinates in the first xy coordinate system of the writing data from the transmitting-side digital pen input device as the reference x The writing data is converted into data in the reference xy coordinate system by converting into coordinates in the -y coordinate system. The operation of the transmission side handwritten data conversion unit 23 will be specifically described with reference to FIG.

  In FIG. 8, the Oxy coordinate system shown on the upper side corresponds to the first xy coordinate system on the first sheet 50, and the O′-XY coordinate system shown on the lower side is This corresponds to the reference xy coordinate system on the edited image. The points 54a and 54b on the first paper 50 correspond to the points O and A in the Oxy coordinate system, and the alignment marks 51a and 51b of the edited image are O′-XY. It corresponds to the point O ′ and the point A ′ in the coordinate system.

The enlargement / reduction ratio of the x-axis and y-axis in the reference xy coordinate system with respect to the x-axis and y-axis in the first xy coordinate system is
x-axis enlargement / reduction ratio: α = O′B ′ / OB
Y-axis enlargement / reduction ratio: β = O′C ′ / OC
The coordinates (x, y) of the point P in the first xy coordinate system (Oxy coordinate system) and the corresponding point Q in the reference xy coordinate system (O′-XY coordinate system) Between the coordinates (X, Y) of the relationship X = x × α
Y = y × β
Is established.
Based on this expression, for example, the coordinates of the point P ₁ (x ₁ , y ₁ ), the point P ₂ (x ₂ , y ₂ ), and the point P ₃ (x ₃ , y ₃ ) in the first xy coordinate system are The point Q ₁ (X ₁ , Y ₁ ), the point Q ₂ (X ₂ , Y ₂ ), and the point Q ₃ (X ₃ , Y ₃ ) in the reference xy coordinate system are converted to coordinates in the reference xy coordinate system. ).

The writing data converted by the transmission side writing data conversion unit 23 is stored in the second transmission side memory 19 and transmitted to the receiving side terminal device 2 by the second transmission side data transmission unit 24.

The incoming side terminal device 2 further includes a second incoming side memory 38 in which handwritten data from the outgoing side terminal device 1 is stored.
The incoming-side digital pen input device 5 has a dedicated pen 44 and a writing data output unit 45 that holds the second paper, detects a writing operation by the dedicated pen 44 on the second paper, and outputs the writing data. is doing. FIG. 6 is a plan view showing an example of the second sheet. In FIG. 6, the second sheet 52 is a sheet for the lecturer to give correction guidance to the students. In FIG. 6, only the part necessary for the description is shown surrounded by a one-dot chain line.

When the point corresponding to the alignment marks 51a and 51b in the edited image displayed on the incoming display unit 32 is designated on the second paper 52 by the dedicated pen 44, the handwritten data output unit 45 is designated. Based on this, a second xy coordinate system is set on the second paper 52, the handwritten data is output together with the coordinates in the second xy coordinate system, and the coordinates of the point in the second xy coordinate system are output. .
FIG. 9 is a diagram illustrating a state in which the second paper 52 is held in the writing data output unit 45 of the incoming-side digital pen input device 5. In FIG. 9, points 53 a and 53 b corresponding to the alignment marks 51 a and 51 b on the screen of the incoming display unit 32 are designated on the second paper 52 by the dedicated pen 44.
The operation of the writing data output unit 45 is the same as that of the writing data output unit 22 of the digital pen input device 4 of the transmitting terminal device 1.

The receiving terminal device 2 is further provided with an incoming writing data conversion unit 42. The incoming side handwritten data conversion unit 42 coordinates the points 53a and 53b in the second xy coordinate system on the second paper 52 and the alignment marks 51a and 51b in the reference xy coordinate system on the edited image. Based on the coordinates, an enlargement / reduction ratio of the x-axis and y-axis between the second xy coordinate system and the reference xy coordinate system is determined, and the second xy of the writing data from the incoming-side digital pen input device 5 is determined. By converting the coordinates in the coordinate system to the coordinates in the reference xy coordinate system, the writing data is converted into data in the reference xy coordinate system.
The incoming side handwritten data conversion unit 42 operates in the same manner as the outgoing side handwritten data conversion unit 23.

The handwritten data converted by the incoming side handwritten data converter 42 is stored in the third incoming side memory 39 and transmitted to the outgoing side terminal device 1 by the second incoming side data transmitter 43.
The receiving terminal device 2 further includes a third incoming image display unit 41. The third incoming image display 41 is stored in the second and third incoming memories 38, 39 each time new writing data is stored in the second or third incoming memories 38, 39. The received data is combined with the data stored in the first incoming side memory 37, stored in the first incoming side memory 37 and the incoming side video memory 33, and the second and third incoming side memories 38. , 39 is cleared.
In FIG. 10, the data stored in the second incoming side memory 38 and the third incoming side memory 39 by the third incoming side image display unit 41 is the data stored in the first incoming side memory 37. And is stored in the incoming video memory 33 and displayed on the incoming display unit 32.

The calling terminal device 1 further has new writing data in the third calling memory 20 storing the writing data from the receiving terminal device 2 and the second or third calling memory 19, 20. Each time the data is stored, the data stored in the second and third calling side memories 19 and 20 are combined with the data stored in the first calling side memory 18 and are combined with the first calling side memory 18. And a second transmission side image display unit 17 for clearing data stored in the second and third transmission side memories 19 and 20 while being stored in the transmission side video memory 13. The second outgoing image display unit 17 operates in the same manner as the third incoming image display unit 41.

FIG. 11 is a diagram illustrating a state in which handwritten data is transmitted and received by the digital pen input devices 4 and 5 between the transmission-side terminal device 1 and the reception-side terminal device 2, and (A) is an edited image. (B) shows a state in which data once input is erased in the receiving terminal device.
According to the distance learning instruction system of the present invention, the student receives the image data of a specific page in the teaching material on which the question to be asked is posted from the transmitting side terminal device 1, and the receiving side terminal device 2 on the instructor side. Send to.

Referring to the upper part of FIG. 11A, the lecturer creates an edited image from the received image data in the receiving terminal device 2. Then, the image data of the edited image is stored in the first incoming side memory 37, the edited image is displayed on the incoming side display unit 32, and the image data of the edited image is also sent to the outgoing side terminal device 1. The transmitted image is stored in the first transmission side memory 18, and the edited image is displayed on the transmission side display unit 12.

  Next, with reference to the middle part of FIG. 11A, the student inputs the question items by handwriting using the transmission-side digital pen input device 4. The input data is converted by the transmission side writing data conversion unit 23, stored in the second transmission side memory 19, synthesized with the data stored in the first transmission side memory 18, and transmitted on the transmission side display unit 12 is displayed. The converted data is transmitted to the receiving terminal device 2, stored in the third receiving memory 39, combined with the data stored in the first receiving memory 37, and displayed on the receiving display unit 32. Is done.

  Next, referring to the lower part of FIG. 11A, the lecturer inputs instruction items for the question items by handwriting by using the incoming-side digital pen input device 5. The input data is converted by the incoming-side writing data conversion unit 42, stored in the second incoming-side memory 38, and stored in the first incoming-side memory 37 (the middle row in FIG. 11A). Data combined in the process) and displayed on the receiving side display unit 32. The converted data is also transmitted to the transmitting terminal device 1, stored in the third transmitting memory 20, and stored in the first transmitting memory 18 (the middle process in FIG. 11A). ) And is displayed on the transmission side display unit 12.

Referring to FIG. 11B, for example, when the lecturer erases previously input data by using the eraser function of the incoming digital pen input device 5 in the incoming terminal 2. The blank page data (zero data) is overwritten in the third incoming side memory 39, and the blank page data is combined with the data stored in the first incoming side memory 37 and displayed on the incoming side display unit 32. Further, this blank paper data is transmitted to the transmission side terminal device 1, stored in the third transmission side memory 20, combined with the data stored in the first transmission side memory 18, and is transmitted to the transmission side display unit 12. Is displayed.

1 is a block diagram illustrating a configuration of a bidirectional data communication system using a digital pen input device according to an embodiment of the present invention. It is a block diagram which shows the structure of a transmission side terminal device. It is a block diagram which shows the structure of a receiving side terminal device. FIG. 6 is a plan view illustrating an example of a first sheet. It is the figure which showed the edited image produced | generated by the image editing part and displayed on the receiving side display part. FIG. 6 is a plan view illustrating an example of a second sheet. It is the figure which showed the state with which the 1st paper was hold | maintained at the writing data output part of the transmission side digital pen input device. It is a figure explaining operation | movement of the transmission side writing data conversion part. It is the figure which showed the state with which the 2nd paper was hold | maintained at the writing data output part of the incoming side digital pen input device. The third incoming image display unit combines the data stored in the second and third incoming memories with the data stored in the first incoming memory and stored in the incoming video memory. It is the figure which showed a mode that it displayed on the receiving side display part. It is the figure explaining a mode that the transmission / reception of the handwritten data by a digital pen input device is performed between a transmission side terminal device and a receiving side terminal device, (A) is addition of handwritten data mutually with respect to an edited image. (B) shows a state in which data once input is erased in the receiving terminal device.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Originating side terminal apparatus 2 Incoming side terminal apparatus 3 Communication network 4 Originating side digital pen input device 5 Incoming side digital pen input device 6 FAX apparatus 7 Public telephone network 8 Mail server 14 Image input part

Claims (3)

A bidirectional data communication system using a digital pen input device,
Having a calling terminal device and a receiving terminal device connected to each other via a communication network;
The calling terminal device is
An image input unit for inputting image data of the first sheet;
A first caller-side data transmitter that transmits image data of the first sheet to the receiver terminal device,
The receiving terminal device is:
A data receiving unit for receiving data from the originating terminal device;
An incoming-side video memory, and when image data is stored in the incoming-side video memory, an incoming-side display unit that displays the image;
A first incoming image display unit that stores image data of the first sheet from the outgoing terminal device in the incoming video memory;
An image editing unit for trimming an image part from the image of the first paper displayed on the incoming-side display unit, and generating an edited image by incorporating an alignment mark in the image part;
A first incoming memory in which image data of the edited image is stored;
A second incoming image display unit for storing the edited image in the incoming video memory;
An incoming-side reference coordinate system setting unit that sets a reference xy coordinate system on the edited image based on position data of the alignment mark;
A first incoming data transmission unit that transmits image data of the edited image to the transmitting terminal device;
The calling terminal device further includes:
A data receiving unit for receiving data from the receiving terminal device;
A first calling-side memory in which image data of the edited image from the receiving-side terminal device is stored;
A transmission-side reference coordinate system setting unit that sets a reference xy coordinate system on the edited image based on position data of the alignment mark;
A transmission side display unit for displaying an image when image data is stored in the transmission side video memory;
A first transmission-side image display unit that stores image data of the edited image in the transmission-side video memory;
A calling-side digital pen input device,
The transmitting-side digital pen input device includes a dedicated pen and a writing data output unit that holds the first paper, detects a writing operation by the dedicated pen on the first paper, and outputs the writing data. When the point corresponding to the alignment mark in the edited image displayed on the transmission side display unit is designated on the first sheet by the dedicated pen, the writing data output unit is designated A first xy coordinate system is set on the first sheet, the writing data is output together with the coordinates in the first xy coordinate system, and the coordinates of the point in the first xy coordinate system Is output,
The calling terminal device further includes:
Based on the coordinates of the point in the first xy coordinate system on the first sheet and the coordinates of the alignment mark in the reference xy coordinate system on the edited image, the first xy coordinate An x-axis and y-axis enlargement / reduction ratio between a system and the reference xy coordinate system is determined, and coordinates in the first xy coordinate system of writing data from the transmitting-side digital pen input device are determined as the reference an outgoing-side writing data conversion unit that converts the writing data into data in the reference xy coordinate system by converting the coordinates in the xy coordinate system;
A second transmission side memory for storing the writing data converted by the transmission side writing data conversion unit;
A second transmission side data transmission unit that transmits the writing data converted by the transmission side writing data conversion unit to the reception side terminal device;
The receiving terminal device further includes:
A second incoming-side memory in which writing data from the outgoing-side terminal device is stored;
A receiving-side digital pen input device, and
The incoming-side digital pen input device has a dedicated pen and a writing data output unit for holding a second sheet and detecting a writing operation by the dedicated pen on the second paper and outputting the writing data. When the point corresponding to the alignment mark in the edited image displayed on the incoming-side display unit is designated on the second sheet by the dedicated pen, the writing data output unit is based on the specified point. A second xy coordinate system is set on the second sheet, the writing data is output together with the coordinates in the second xy coordinate system, and the coordinates of the point in the second xy coordinate system are output. Output,
The receiving terminal device further includes:
Based on the coordinates of the point in the second xy coordinate system on the second sheet and the coordinates of the alignment mark in the reference xy coordinate system on the edited image, the second xy coordinate An x-axis and y-axis enlargement / reduction ratio between the system and the reference xy coordinate system is determined, and coordinates in the second xy coordinate system of writing data from the incoming-side digital pen input device are determined as the reference an incoming-side writing data conversion unit that converts the writing data into data in the reference xy coordinate system by converting the coordinates in the xy coordinate system;
A third incoming memory in which the handwritten data converted by the incoming handwritten data converter is stored;
A second incoming data transmission unit that transmits the written data converted by the incoming side writing data conversion unit to the transmitting terminal device;
Each time new writing data is stored in the second or third receiver memory, the data stored in the second and third receiver memories is stored in the first receiver memory. A third incoming image display that combines the data and stores it in the first incoming memory and the incoming video memory, and clears the data stored in the second and third incoming memories. And comprising
The calling terminal device further includes:
A third calling-side memory in which writing data from the receiving-side terminal device is stored;
Each time new writing data is stored in the second or third caller memory, the data stored in the second and third caller memories is stored in the first caller memory. A second caller image display that combines the data and stores it in the first caller memory and the caller video memory and clears the data stored in the second and third caller memories And a bidirectional data communication system. The bidirectional mark according to claim 1, wherein the alignment mark incorporated in the edited image is two vertices positioned on a diagonal line of a selected rectangular frame portion in the edited image. Data communication system. The transmission side terminal device includes a FAX device instead of the image input unit and the first transmission side data transmission unit, and the bidirectional data communication system is further connected to the Internet and a public telephone network The mail server is connected to the FAX apparatus via the mail apparatus, and the mail server attaches the image data of the first sheet received from the FAX apparatus to the e-mail as a file attachment to the receiving terminal apparatus. And when the e-mail is received by the data receiving unit of the receiving terminal device, the first paper attached to the e-mail by the first receiving image display unit The bidirectional data according to claim 1 or 2, wherein image data is stored in the incoming video memory. Shin system.

Images