JP2010251919A - Terminal device, repeating device, conference support system, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a terminal device which can instruct transmission of a memorandum after it is written, or cancel the memorandum which is transmitted once, to provide a repeating device, to provide a conference support system, and to provide a program. <P>SOLUTION: The terminal device detects the memorandum image written in a touch panel 612 using a touch pen 110a for a conference document displayed on a liquid crystal display 613, and displays on the liquid crystal display 613. The displayed memorandum image is transmitted to another device when a memorandum image transmission key 1603 is touched with the touch pen 110a. If the image transmission key 1603 is touched after the memorandum image displayed on the liquid crystal display 613 is erased with the touch pen 110a, the display image in which the memorandum image is erased, is transmitted to another device. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a terminal device, a relay device, a conference support system, and a program, and more particularly to a technique for exchanging memos for conference materials among conference attendees.

Conventionally, when a person consults face-to-face, such as at a meeting or a meeting, the talk is often carried out while showing the notes written on the materials at hand, especially when the talk is complicated. Examples of such cases include a case where a route to a destination is examined while looking at a map, and a case where machine design is performed with reference to drawings.
In recent years, there is no change in the demand for video conferencing systems that have become widespread in recent years, and it is desirable that the conference can be advanced while showing notes. For this reason, for example, when a video conference is held between a plurality of bases, a technique for transmitting memo data input at each base to another base has been developed.

However, some memos do not need to be shown to other attendees, so it may be a problem if all memo data is sent to other locations.
For this reason, a technique has been proposed that prohibits transmission of memo data to other locations if the local drawing mode is set when a memo is input (see Patent Document 1). In this way, only necessary memos can be transmitted to other bases while all memos are displayed on the terminal at hand.

JP-A-6-165171

However, even a memo input in the local drawing mode may need to be transmitted later to another base. On the contrary, there is a case where it is desired to cancel the memo once transmitted, but such an operation cannot be performed by the above-described conventional technology.
The present invention has been made in view of the above-described problems, and it is possible to instruct the transmission of the memo after the memo has been entered, or to cancel the memo that has been transmitted, thereby eliminating the memo writing error. It is an object to provide a terminal device, a relay device, a conference support system, and a program.

  To achieve the above object, a terminal device according to the present invention is a terminal device included in a conference support system in which a plurality of terminal devices are connected to a network, and accepting means for receiving data to be written in conference materials from a user And the receiving means for receiving the data written in the conference material from the other terminal device, the own data that is the data received by the receiving means, and the other data that is the data received by the receiving means Combining means for generating synthesized data, display means for displaying the synthesized data, and transmitting means for transmitting own data to another terminal device when receiving a transmission instruction from the user, the synthesizing means is provided in the receiving means. Among the other data received in this manner, the latest other data is synthesized for each other terminal device.

If it does in this way, the transmission means can instruct the transmission after filling in the memo (own data), and the memo once transmitted by the synthesis means is replaced with the next transmitted memo, so You can cancel a note.
In this case, if the display means displays the part already transmitted by the transmission means and the part not yet transmitted in its own data in a different manner, the transmitted part and the untransmitted part are clearly indicated. Can be distinguished.

In addition to the own data and other data, the synthesizing unit further synthesizes the conference material data for displaying the conference material, and the accepting unit is a touch panel arranged on the display surface of the display unit. It is characterized by receiving data.
Also, if the transmission means compresses its own data and transmits it to another terminal device, the network load can be reduced and smooth communication can be realized.

The receiving unit may receive data from another terminal device via the relay device, and the data from the other terminal device may be combined into one data by the relay device. In this way, it is possible to reduce the processing load on the terminal device required for data synthesis.
In addition, the relay device according to the present invention is a relay device that relays data to be written to conference materials transmitted and received between a plurality of terminal devices in a conference support system in which a plurality of terminal devices are connected to a network. Receiving means for receiving data from the terminal device, combining means for combining the received data, and transmitting means for transmitting the combined data to the terminal device, wherein the combining means includes a transmission destination of the combined data, The data received from the terminal device other than the terminal device is synthesized. In this way, it is possible to transmit data from which unnecessary portions have been deleted from the terminal device to the relay device.

In this case, the recording means for recording the meeting material data for displaying the meeting material is provided, and the transmission means transmits the memo (data) from the terminal device and the meeting if the meeting material data is transmitted together with the data synthesized by the synthesizing means. It can be displayed on the terminal device in association with the document data.
Also, if you have a printing means that synthesizes the data synthesized by the synthesis means and the meeting material data and prints it, the meeting materials with notes added will be printed out as minutes and distributed to the attendees of the meeting Etc.

  In addition, the conference support system according to the present invention includes a plurality of terminal devices and a relay device that relays data that is written to the conference material and is transmitted and received between the plurality of terminal devices. The terminal device includes a receiving unit that receives data from the user, a first receiving unit that receives data from the relay device, own data that is data received by the receiving unit, and a receiving unit. When receiving a transmission instruction from a user, a first synthesizing unit that synthesizes the received data with other data to generate synthesized data, a display unit that displays the synthesized data, and transmits the data to another terminal device First transmitting means for combining, the first synthesizing means for synthesizing only the last received other data, and the relay apparatus receiving second data for receiving data from the terminal apparatus, Second combining means for combining the combined data and second transmission means for transmitting the combined data to the terminal device, wherein the second combining means is a terminal other than the terminal device that is the transmission destination of the combined data. The latest data received from the terminal device is synthesized.

If it does in this way, the transmission of the memo can be instructed after the memo has been entered, the memo once transmitted can be canceled, and the processing load of the terminal device can be reduced.
Further, the program according to the present invention is a program executed by a terminal device included in a conference support system in which a plurality of terminal devices are connected to a network, and accepting data for writing to conference materials from a user; Combining the reception step of receiving data written in the conference material from another terminal device, the own data that is the data received in the reception step, and the other data that is the data received in the reception step A synthesizing step, a display step for displaying the synthesizing data, and a transmitting step for transmitting the own data to another terminal device when receiving a transmission instruction from the user. The synthesizing step is received at the receiving step. Among the other data, the latest other data is synthesized for each other terminal device.

  In addition, the program according to the present invention is executed by a relay device that relays data to be written to a conference material transmitted and received between a plurality of terminal devices in a conference support system in which a plurality of terminal devices are connected to a network. A program comprising: a receiving step for receiving data from the terminal device; a combining step for combining the received data; and a transmitting step for transmitting the combined data to the terminal device. It is characterized in that data received from a terminal device other than the terminal device as a transmission destination is synthesized.

  By using such a program, the same effect as described above can be obtained.

It is a figure which shows the main structures of the meeting assistance system which concerns on embodiment of this invention. 2 is a diagram illustrating a hardware configuration of MFP 100. FIG. 2 is a block diagram showing a main functional configuration of MFP 100. FIG. 3 is a diagram illustrating a data structure of an image management table 310. FIG. FIG. 6 is a diagram illustrating a merge image generated from original image data 311 and client image data 312 by a layer image merge unit 305. It is a figure which shows the hardware constitutions of PC110. It is a block diagram which shows the main function structures of PC110. 5 is a flowchart showing the operation of MFP 100. It is a flowchart which shows the detail of an image data recording process. 3 is a diagram illustrating a data structure when image data is transmitted and received between the MFP 100 and the PCs 110 to 113. FIG. It is a flowchart which shows the detail of an image data delivery process. It is a flowchart which shows the detail of an image data printing process. It is a flowchart which shows main operation | movement of PC110. It is a flowchart which shows the detail of an image data reception process. It is a flowchart which shows the detail of a touch input process. It is a figure which shows the display screen of the liquid crystal display 613 of PC110. It is a flowchart which shows the detail of a transmission mode switching process. It is a figure which shows the display of the liquid crystal display 613 for every transmission mode, Comprising: (a) shows the display in batch mode, (b) shows the display in sequential mode. It is a flowchart which shows the detail of a memo image transmission process. It is a flowchart which shows the detail of a handwriting input process. It is a figure which illustrates the procedure which displays a figure in the detected coordinate position. It is a flowchart which shows the detail of an input mode switching process. It is a figure which shows the display of the liquid crystal display 613 for every input mode, Comprising: (a) shows the display in writing mode, (b) shows the display in erasing mode. It is a figure which illustrates operation in erase mode. It is a figure which illustrates image data transmission operation concerning the modification of this invention. It is a figure which illustrates operation at the time of canceling transmission of image data concerning the modification of the present invention.

Hereinafter, embodiments of a conference support system and a conference support program according to the present invention will be described with reference to the drawings.
[1] System Configuration First, the system configuration of the conference support system according to the present embodiment will be described.
FIG. 1 is a diagram showing a main configuration of the conference support system according to the present embodiment. As shown in FIG. 1, the conference support system 1 includes a multifunction peripheral (MFP) 100 and personal computers (PCs) 110 to 113 connected via a network 120.

The MFP 100 has functions such as a printer function, a facsimile function, a copy function, and a scanner function. The PCs 110 to 113 include touch panels 110a to 113a and touch pens 110b to 113b, respectively, and can accept pen input directly on the display screen.
[2] Configuration of MFP 100 Next, the configuration of MFP 100 will be described.

  FIG. 2 is a diagram illustrating a hardware configuration of the MFP 100. As shown in FIG. 2, the MFP 100 includes a central processing unit (CPU) 201, a read only memory (ROM) 202, a random access memory (RAM) 203, a hard disk drive (HDD) 204, and a network interface card (NIC) 205. An input / output interface 206, an operation panel 211, a scanner 212, a print engine 213, and a facsimile interface 214.

Note that the CPU 201, ROM 202, RAM 203, HDD 204, NIC 205, and input / output interface 206 are connected by an internal bus 200. The operation panel 211, the scanner 212, the print engine 213, and the facsimile interface 214 are connected to the input / output interface 206 via the input / output bus 210.
The CPU 201 reads and boots a boot program from the ROM 202 when the power is turned on, and executes processing using the RAM 203 as a working memory area. The HDD 204 records data such as conference materials. The NIC 205 executes processing for the CPU 201 to communicate with the PCs 110 to 113 via the network 120.

The input / output interface 206 is an interface device for the CPU 201 to control the operation panel 211, the scanner 212, the print engine 213, and the facsimile interface 214.
The operation panel 211 includes hard keys 211a, a touch panel 211b, and a liquid crystal display (LCD) 211c. The operation panel 211 displays information for the user on the liquid crystal display 211c, or receives an instruction input from the user on the hard key 211a or the touch panel 211b.

  The scanner 212 reads an original document and generates image data under the control of the CPU 201. The generated image data is recorded in the HDD 204. The print engine 213 uses the image data recorded in the HDD 204 to form a color image by electrophotography and prints it on a recording sheet. The facsimile interface 214 is an interface device for transmitting and receiving image data via a facsimile line.

Using the hardware configured as described above, the MFP 100 realizes the following functions. FIG. 3 is a block diagram showing the main functional configuration of MFP 100.
As shown in FIG. 3, the MFP 100 includes a communication control unit 301, a received image management unit 302, an image distribution management unit 303, a rendering processing unit 304, a layer image merging unit 305, an input processing unit 306, a print instruction receiving unit 307, a display. Functional elements such as a processing unit 308 and an image formation control unit 309 are included. These functions are realized by the CPU 201 reading and executing a program from the HDD 204.

The communication control unit 301 controls the NIC 205 and transmits / receives data to / from the PCs 110 to 113 via the network 120. The communication control unit 301 also executes protocol processing such as TCP / IP (transmission control protocol / internet protocol).
The received image management unit 302 manages image data received from the PCs 110 to 113 via the network 120. The image data managed by the received image management unit 302 is original image data 311 that is conference material received from a conference presenter and client image data 312 that is image data received from a conference participant.

Image data managed by the received image management unit 302 is recorded in the RAM 203 and managed using the image management table 310. An image management table 310 is also recorded in the RAM 203.
FIG. 4 is a diagram illustrating the data structure of the image management table 310. As shown in FIG. 4, the image management table 310 includes three types of tables: a conference registration table, an original image table, and a storage address table. In the conference registration table, the number of registered conferences and conference identifiers corresponding to the number of conference registrations that are identifiers of individual conferences are recorded.

The original image table is a table provided for each conference identifier, and records a corresponding conference identifier, the number of related original images, and original image identifiers for the number of original images.
The storage address table is a table provided for each original image identifier, and records the corresponding original image identifier, the storage address of the original image data 311, and the size of the original image data 311. The storage address indicates a recording position in the RAM 203.

The storage address table further records the number of clients of the conference, the IP addresses for the number of clients, the image data storage address, and the image data size. The image data storage address is an address where the client image data 312 is stored, and the image data size is the data length of the client image data 312.
The rendering processing unit 304 converts the image data received as vector information from the PCs 110 to 113 by the reception image management unit 302 into bitmap information, and stores the bitmap data in the RAM 203 as client image data 312. If image data is transmitted and received as vector information, the amount of communication data can be reduced.

The image distribution management unit 303 distributes the image data obtained by merging (superimposing) the original image data 311 and the client image data 312 recorded in the RAM 203 to each of the PCs 110 to 113. At this time, the image distribution management unit 303 specifies the distribution destination of the image data and requests the layer image merge unit 305 to generate the image data.
Each of the original image data 311 and the client image data 312 from the PCs 110 to 113 is managed as one layer. In response to a request from the image distribution management unit 303, the layer image merge unit 305 reads the original image data 311 and the client image data 312 from the RAM 203, and merges (superimposes) the image data including one layer. Generate.

In this case, the client image data 312 from the distribution destination designated by the image distribution management unit 303 is excluded from the merge target. The layer image merging unit 305 also merges the original image data 311 and the client image data 312 in response to a request from the image formation control unit 309 to generate image data (hereinafter referred to as “merge image”).
FIG. 5 is a diagram illustrating a merge image generated by the layer image merge unit 305 from the original image data 311 and the client image data 312. As shown in FIG. 5, when the layer image merging unit 305 is requested by the image distribution management unit 303 to generate a merge image, the layer image merging unit 305 and the client image data 312 excluding the client image data 312 of the designated distribution destination. A merge image is generated from the image data 311.

When the image formation control unit 309 requests generation of a merge image, the merge image 501 is generated from the original image data 311 and all the client image data 312. The generated merged image is distributed to the distribution destination designated by the image distribution management unit 303 or printed by the image formation control unit 309.
The input processing unit 306 receives user input from the H / W key 211a and the touch panel 211b. If the user input received by the input processing unit 306 is a print instruction, the print instruction receiving unit 307 requests the image formation control unit 309 to print the instructed image.

The image formation control unit 309 requests the layer image merge unit 305 to generate image data, and causes the print engine 213 to print the image data. While the image forming control unit 309 causes the print engine 213 to execute the printing process, the display processing unit 308 displays that fact on the liquid crystal display 211c.
[3] Configuration of PCs 110 to 113 Next, the configuration of the PCs 110 to 113 will be described. Since the PCs 110 to 113 all have the same configuration, only the configuration of the PC 110 will be described here, and instead of the description of the PCs 111 to 113.

FIG. 6 is a diagram illustrating a hardware configuration of the PC 110. As shown in FIG. 6, the PC 110 includes a CPU 601, ROM 602, RAM 603, HDD 604, NIC 605, input / output interface 606, keyboard 611, touch panel 612, and liquid crystal display 613.
The CPU 601, ROM 602, RAM 603, HDD 604, NIC 605, and input / output interface 606 are connected by an internal bus 600. The keyboard 611, the touch panel 612, and the liquid crystal display 613 are connected to the input / output interface 606 via the input / output bus 610.

The CPU 601 reads and starts a boot program from the ROM 602 when the power is turned on, and executes processing using the RAM 603 as a working memory area. The HDD 604 records original image data. The NIC 605 executes processing for the CPU 601 to communicate with the MFP 100 and other PCs via the network 120.
The input / output interface 606 is an interface device for the CPU 601 to exchange data with the keyboard 611, the touch panel 612, and the liquid crystal display 613. The input / output interface 606 displays information for the user on the liquid crystal display 613, and receives an instruction input from the user on the keyboard 611 or the touch panel 612.

The PC 110 implements the following functions using the hardware configured as described above. FIG. 7 is a block diagram showing the main functional configuration of the PC 110.
As shown in FIG. 7, the PC 110 includes a communication control unit 701, a received image management unit 702, an image distribution management unit 703, an input processing unit 704, a coordinate acquisition unit 705, a handwriting drawing unit 706, a display processing unit 707, and a layer image merge. Functional elements such as a unit 708 and a rendering processing unit 709 are included. These functions are realized by the CPU 601 reading a program from the HDD 604 and executing it.

The communication control unit 701 transmits and receives data via the network 120 to and from the MFP 100 and other PCs by controlling the NIC 605 and performing protocol processing such as TCP / IP.
Received image management unit 702 manages merged image data 710 received from MFP 100 via network 120. If the user of the PC 110 is a conference participant and not a presenter, the original image data 711 received from the MFP 100 is also managed. These image data are recorded in the RAM 603.

The coordinate acquisition unit 705 acquires the coordinate value of the position where the touch pen 110 a touches the touch panel 612 and notifies the input processing unit 704 of the coordinate value. The input processing unit 704 requests the handwritten drawing unit 706 and the image distribution management unit 703 to record the input image and distribute the image according to the coordinate value notified from the coordinate acquisition unit 705 and the input value from the keyboard 611.
The handwriting drawing unit 706 records a memo image input to the touch panel 612 by the user of the PC 110 on the touch pen 110a in the RAM 603 as vector information connecting the coordinate values.

In response to a request from the layer image merging unit, the rendering processing unit 709 converts the memo image data 712 that is vector information into bitmap information, and outputs the bitmap information to the layer image merging unit.
The layer image merge unit 708 reads merge image data 710 and original image data 711 recorded in the RAM 603. Also, the layer image merge unit 708 requests the rendering processing unit 709 to output the memo image data 712 converted into bitmap information.

Then, the layer image merging unit 708 outputs the image data obtained by merging the merged image data 710, the original image data 711, and the memo image data 712 converted into bitmap information to the display processing unit 707. The display processing unit 707 displays the input image data on the liquid crystal display 613.
[4] Operation of MFP 100 Next, the operation of MFP 100 will be described.

FIG. 8 is a flowchart showing the operation of the MFP 100. As shown in FIG. 8, the MFP 100 first confirms whether image data has been received from any of the PCs 110 to 113, and if image data has been received (S <b> 801: YES), the MFP 100 stores the image data. In order to record in the RAM 203, an image data recording process is executed (S802).
When the execution of the image data recording process is completed, the image data distribution process is executed to update the liquid crystal display display of the PCs 110 to 113 with the new image data (S803). If no image data has been received from any of the PCs 110 to 113 (S801: NO), an image data printing process for printing the image data as a meeting minutes is executed (S805).

When the processes of steps S803 and S805 are completed, the process proceeds to step S801, and the above processes are repeated.
(1) Image data recording process (S802)
FIG. 9 is a flowchart showing details of the image data recording process. As shown in FIG. 9, in the image data recording process, first, it is confirmed whether or not the received image data is original image data.

  FIG. 10 is a diagram illustrating a data structure when image data is transmitted / received between the MFP 100 and the PCs 110 to 113. In the present embodiment, a conference identifier field 1001, an original image identifier field 1002, an image data number field 1003, and an image data field 1004 are provided. Further, the image data storage field 1004 stores the number of image data indicated by the image data number field 1003 (n in FIG. 10).

Each of the image data # 1 to #n includes a type field 1011, a size field 1012, and an image data field 1013. The type field 1011 stores a value indicating which type of image data stored in the image data field belongs to the original image data, merged image data, and memo image data.
The size field 1012 stores a value indicating the size of the image data stored in the image data field 1013 in bytes. The image data field 1013 stores the image data itself.

  Image data is transmitted and received using a TCP / IP procedure. That is, a TCP header is attached to data having a structure as shown in FIG. 10, divided into a plurality according to the size, and then transmitted and received as IP packets each having an IP header attached. The MFP 100 and the PCs 110 to 113 that have received the image data can acquire the IP address of the transmission source with reference to the IP header attached to the image data.

The received image management unit 302 refers to the value of the type field of the received image data. If the value indicates memo image data (S901: YES), the received image management unit 302 sends the image data ( Memo image data) is converted from vector information to bitmap information (S902).
When the type of the received image data is not memo image data (S901: NO), and after the process of step S902, the image data is recorded in the RAM 203 (S903), and the image management table 310 is updated (S904). In this case, the values of the conference identifier field 1001 and the original image identifier field 1002 described above, and the IP address of the transmission source are recorded in the corresponding column of the image management table 310.

When the above processing is completed, the process returns to the upper routine.
(2) Image data distribution processing (S803)
Next, image data distribution processing will be described.
FIG. 11 is a flowchart showing details of the image data distribution process. When the image data recording process (S802) is completed, the original image data 311 and the merged image data are distributed by the image distribution management unit 303 in order to update the liquid crystal display display of the PCs 110 to 113.

As shown in FIG. 11, in the image data recording process, the distribution destination, that is, The processing from step S1102 to step S1107 is executed for each of the PCs 110 to 113.
First, in order to generate a merge image, the processing from step S1103 to step S1104 is executed for each client image data 312. That is, with reference to the storage address table of the image management table 310, if the value of the IP address field does not match the IP address of the distribution destination (S1103: NO), it is stored in the image data storage address corresponding to the IP address. The obtained image data is merged with the merged image (S1104).

  When the value of the IP address field matches the IP address of the distribution destination (S1103: YES), the image data is not merged. In this way, when a merge image is generated by merging image data other than the image data received from the distribution destination, the merge image data is transmitted to the distribution destination (S1106), and the original image data 311 is transmitted to the distribution destination. (S1107).

  Also in the case of this transmission, the data structure of FIG. 10 is adopted, and the values of the conference identifier field and the original image identifier field received by the received image management unit 302 are stored in the conference identifier field and the original image identifier field, respectively. The Further, the value 2 is stored in the image data number field, and the original image data and the merged image data are stored in the image data field.

When the above processing is completed for all the delivery destinations, the process returns to the upper routine.
(3) Image data printing process (S805)
Next, the image data printing process will be described.
FIG. 12 is a flowchart showing details of the image data printing process. As shown in FIG. 12, first, the layer image merge unit 305 creates merge image data by merging all the client image data 312 (S1201). The layer image merge unit 305 merges the original image data 311 with the merged image data (S1202). The merged image obtained in this way is printed as a meeting minutes by controlling the print engine 213 in the image formation control unit 309 (S1203).

[5] Operation of PC 110 Next, the operation of the PC 110 will be described. Since the PCs 111 to 113 operate in the same manner, the description of the operation of the PC 110 is replaced with the description of the operation of the PCs 111 to 113.
FIG. 13 is a flowchart showing main operations of the PC 110. As illustrated in FIG. 13, when the communication control unit 701 receives image data (S1301: YES), the PC 110 executes an image data reception process (S1302). If image data is not received by the communication control unit 701 (S1301: NO), if touch input to the touch panel 612 by the touch pen 110a is detected (S1303: YES), touch input processing is executed (S1304).

After the processes of steps S1302 and S1304 are completed and when no touch input is detected (S1303: NO), the process proceeds to step S1301 and the above process is repeated.
(1) Image data reception processing (S1302)
Next, image data reception processing will be described.
FIG. 14 is a flowchart showing details of the image data reception process. As shown in FIG. 14, first, when the received image management unit 702 receives image data from the communication control unit 701, the received image management unit 702 refers to the type field of the image data (S1401). If the value of the type field indicates the original image data (S1402: YES), it is recorded in the RAM 603 as the original image data 711 (S1403).

If the value of the type field indicates a merge image (S1402: NO), it is recorded in the RAM 603 as merge image data 710 (S1406). After that, the layer image merge unit 708 merges the merge image data 710, the original image data 711, and the memo image data 712 recorded in the RAM 603 (S1404).
By displaying the data thus obtained on the liquid crystal display 613, the display processing unit 707 updates the display display (S1405). Thereafter, the process returns to the upper routine.

(2) Touch input processing (S1304)
Next, touch input processing will be described.
FIG. 15 is a flowchart showing details of the touch input process. As shown in FIG. 15, first, when the touch pen 110 a touches the touch panel 612, an interrupt signal is input to the CPU 601. In response to the input of this interrupt signal, the coordinate acquisition unit 705 acquires coordinate data of the position touched by the touch pen 110a from the touch panel 612 (S1501).

  FIG. 16 is a diagram showing a display screen of the liquid crystal display 613 of the PC 110. As shown in FIG. 16, on the liquid crystal display 613, a handwritten area 1601 is displayed, and an original image transmission key 1602, a memo image transmission key 1603, an input mode switching key 1604, and a transmission mode switching key 1605 are displayed. The original image transmission key 1602, the memo image transmission key 1603, the input mode switching key 1604, and the transmission mode switching key 1605 are all so-called soft keys.

If the coordinate value acquired by the coordinate acquisition unit 705 is within the display area of the transmission mode switching key 1605 (S1502: YES), it is determined that the transmission mode switching key 1605 has been pressed, and transmission mode switching processing is performed. Is executed (S1503).
If the coordinate value is within the display area of the original image transmission key 1602 (S1504: YES), it is determined that the original image transmission key 1602 has been pressed, and the original image data 711 is transmitted to the MFP 100 (S1505).

If the coordinate value is within the display area of the memo image transmission key 1603 (S1506: YES), it is determined that the memo image transmission key 1603 has been pressed, and the memo image transmission process is executed (S1507).
If the coordinate value is within the handwriting area 1601 (S1508: YES), handwriting input processing is executed to record a handwritten input graphic or the like (S1509).

If the coordinate value is in the input mode switching key 1604 (S1510: YES), input mode switching processing is executed (S15011).
After the processing of steps S1503, S1505, S1507, S1509, and S1511 and when the determination is negative in step S1510, the process returns to the upper routine.
(3) Transmission mode switching process (S1503)
Next, the transmission mode switching process will be described. The user of the PC 110 can select either the batch mode or the sequential mode as a method for transmitting the memo image.

In the collective mode, images input on the touch panel 612 are temporarily stored in the RAM 603 and then transmitted to the MFP 100 collectively in accordance with a user instruction. In the sequential mode, the characters input on touch panel 612 are sequentially transmitted to MFP 100.
FIG. 17 is a flowchart showing details of the transmission mode switching process. As illustrated in FIG. 17, the input processing unit 704 refers to the current transmission mode, and if the mode is the sequential mode (S1701: YES), the input processing unit 704 transitions to the batch mode (S1702). On the other hand, if the mode is not the sequential mode (S1701: NO), the mode is changed to the sequential mode (S1703).

Thereafter, the display on the liquid crystal display 613 is updated in accordance with the new transmission mode, and the process returns to the upper routine. FIG. 18 is a diagram showing the display on the liquid crystal display 613 for each transmission mode, where (a) shows the display in the collective mode, and (b) shows the display in the sequential mode.
As shown in FIG. 18A, in the collective mode, “collective” characters are displayed on the transmission mode switching key 1605 to indicate that the collective mode is selected. In addition, the memo image transmission key 1603 is activated in order to instruct the user when to transmit the memo images at once.

In the sequential mode, as shown in FIG. 18B, the characters “sequential” are displayed on the transmission mode switching key 1605 to indicate that the mode is the sequential mode. Further, since the memo images are transmitted sequentially, the display of the memo image transmission key 1603 is switched to halftone, and it is displayed that the memo image transmission key 1603 is invalidated.
(4) Memo image transmission processing (S1507)
Next, the memo image transmission process will be described.

FIG. 19 is a flowchart showing details of the memo image transmission process. As shown in FIG. 19, in the memo image transmission process, first, it is confirmed whether or not the current transmission mode is the batch mode. If the transmission mode is the batch mode (S1901: YES), memo image data 712 is transmitted to MFP 100 (S1902).
(5) Handwriting input processing (S1509)
Next, the handwriting input process will be described.

FIG. 20 is a flowchart showing details of the handwriting input process. As shown in FIG. 20, in the handwriting input process, first, the handwriting drawing unit 706 displays a predetermined graphic on the liquid crystal display 613 at a position where the touch pen 612 is touched with the touch pen 110a.
FIG. 21 is a diagram illustrating a procedure for displaying a graphic at the detected coordinate position. First, when a position (touch position) 2102 touched by the touch pen 110a of the touch panel 612 is detected (FIG. 21A), a circle (graphic figure 2103) centering on the touch position is drawn with a broken line (FIG. 21). (B)). Then, after the figure 2103 is painted in gray (FIG. 21C), the figure 2101 drawn immediately before and the figure 2103 are connected by a gray straight line having a thickness equal to these diameters.

In this way, by dividing the boundary with a broken line and painting it in gray, an untransmitted portion in the memo image is displayed.
Whether or not the figure drawn this time is connected to the figure drawn immediately before is determined, for example, by whether or not the time interval at which the touch position related to these figures is detected falls below a predetermined time (for example, 1 second). do it. That is, if the detection time interval is less than 1 second, it is possible to connect, otherwise it may not be connected.

  When the figure is drawn as described above, vector information is generated (S2002). In the example shown in FIG. 21, the coordinate values of the touch positions related to the graphics 2101 and 2103 and their connection relation are used as vector information. In the case of an isolated figure that is not connected to another figure, only the coordinate position is used as vector information. The generated vector information is added to the memo image data 712, whereby the memo image data 712 is updated (S2003).

  Finally, when the transmission mode is the sequential mode (S2004: YES), the image distribution management unit 703 reads the memo image data 712 from the RAM 603 and transmits it to the MFP 100. At the same time, the broken line that demarcates the boundary of the untransmitted memo image is changed to a solid line, and the part painted in gray is changed to black. As a result, the fact that the portion of the memo image has been transmitted is displayed (FIG. 21 (e)).

The memo image data 712 is displayed on the liquid crystal display of another PC by being distributed to the MFP 100.
(6) Input mode switching process (S1511)
Next, the input mode switching process will be described. The user of the PC 110 can select either the writing mode or the erasing mode as a method for writing the memo image.

FIG. 22 is a flowchart showing details of the input mode switching process. As shown in FIG. 22, the input processing unit 704 refers to the current input mode, and if it is the write mode (S2201: YES), the input processing unit 704 transitions to the erase mode (S2202). If the writing mode is not set (S2201: NO), the mode is changed to the writing mode (S2203).
Thereafter, the display on the liquid crystal display 613 is updated in accordance with the new transmission mode, and the process returns to the upper routine. FIG. 23 is a diagram showing the display on the liquid crystal display 613 for each input mode, where (a) shows the display in the write mode and (b) shows the display in the erase mode.

As shown in FIG. 23A, in the writing mode, the characters “write” are displayed on the input mode switching key 1604 to indicate that it is in the writing mode. Further, in the erase mode, as shown in FIG. 23B, the character “Erase” is displayed on the input mode switching key 1604 to indicate that it is the erase mode.
FIG. 24 is a diagram illustrating an operation in the erase mode. As shown in FIG. 24, when the input mode is the erasing mode and the point touched by the touch pen 110a is on any figure, for example, when the touch pen 110a touches a point on the figure 2402. (FIG. 24 (a)), the graphic 2402 and the graphic 2041 connected to the graphic 2402 and the display of the straight lines connecting these graphics are changed.

  For example, the boundaries of the connected graphic areas (FIGS. 2401 and 4022 and the straight line connecting them) are displayed with broken lines, and the interior is displayed with gray (FIG. 24B). If the touch pen 110a does not touch a point outside the graphic area within a predetermined time (for example, 1 second) from this state, and the touch of the touch pen 110a is not detected, the graphic constituting the graphic area Are deleted from the memo image data 712.

  Then, the display on the liquid crystal display 613 is updated based on the deleted memo image data 712 (FIG. 24C). In this case, a figure that is not connected to the figures 2401 and 2402, for example, the figure 2403 continues to be displayed without being deleted. Further, as described above, the deleted memo image data 712 is transmitted to other PCs sequentially or collectively according to the transmission mode.

In this way, the memo once entered is erased.
[6] Modifications Although the present invention has been described based on the embodiments, it is needless to say that the present invention is not limited to the above-described embodiments, and the following modifications can be implemented. .
(1) Although not particularly mentioned in the above embodiment, the network 120 may be a local area network (LAN) or a wide area network (WAN).

(2) In the above embodiment, the case where a PC is used exclusively as a terminal has been described. However, it goes without saying that the present invention is not limited to this, and a terminal other than a personal computer such as electronic paper may be used. The input means is not limited to the touch pen, and may be a means other than the touch pen, such as a keyboard or a mouse.
(3) In the above embodiment, the case where the memo image data from the PCs 110 to 113 is once collected in the MFP 100 and then distributed to each PC has been described. Needless to say, the present invention is not limited to this. Instead of this, the following may be used.

  That is, instead of transmitting memo image data to MFP 100, PCs 110 to 113 may directly send memo image data to each other. In this case, the PCs 110 to 113 need to merge the memo image data (client image data) and display them on the liquid crystal display. The processing required for this merging is as described for MFP 100 in the above embodiment.

(4) In the above embodiment, a case has been described in which a non-transmitted graphic is displayed in gray and a transmitted graphic is displayed in black. However, it goes without saying that the present invention is not limited to this. Other colors may be used.
For example, a color display may be used, such as displaying an untransmitted graphic in red and displaying a transmitted graphic in blue. Further, when the user inputs a memo image in color, an untransmitted graphic may be displayed in a light color tone, and a transmitted graphic may be displayed in a dark color tone. Any color may be used as long as the presence or absence of transmission can be distinguished regardless of the color for displaying the graphic.

  (5) Although the case where image data is transmitted as vector information has been described in the above embodiment, it goes without saying that the present invention is not limited to this, and image data may be transmitted after being compressed. When all the users of the PCs 110 to 113 frequently write memos, memo image data is frequently transmitted, and the network 120 may be congested.

On the other hand, if the image data is compressed and transmitted, the load on the network 120 can be reduced and the occurrence of congestion can be suppressed.
(6) In the above-described embodiment, the case where the original image data is distributed from the PCs 110 to 113 to the other PC by transmitting to the MFP 100 has been described. Needless to say, the present invention is not limited to this. Instead, it may be as follows.

In other words, the meeting material may be read by the scanner 212 provided in the MFP 100 to generate image data, and the image data may be used as the original image data 311. Even if it does in this way, the effect of the present invention is the same.
(7) In the above embodiment, a case has been described in which any PC transmits all memo image data. However, it goes without saying that the present invention is not limited to this, and the following may be used instead. .

That is, only the image data related to the designated figure among the inputted figures (memos) may be transmitted. FIG. 25 is a diagram illustrating an image data transmission operation according to this modification. As shown in FIG. 25, the non-transmitted figures 2501 and 2502 have their outlines displayed as solid lines and the inside thereof displayed in gray (FIG. 25A).
In this state, when the touch pen 110a is dragged from a point 2503 outside the figure 2501 to another point 2504, a rectangular area 2505 partitioned by a broken line is displayed (FIG. 25B). When the touch pen 110a is moved away from the touch panel 612 while the rectangular area 2505 surrounding the figure 2501 is displayed, the display of the boundary of the figure 2501 is changed from a solid line to a broken line (FIG. 25C).

  In this display state, when a “transmission state change key” (not shown) displayed on the liquid crystal display 613 is touched with the touch pen 110a, vector information related to the graphic 2501 and vector information related to other transmitted graphics are displayed. Are transmitted to the MFP 100. Then, the boundary of the graphic 2501 is displayed as a solid line, and the inside is displayed in black, thereby displaying that the graphic 2501 has been transmitted (FIG. 25D).

  FIG. 26 is a diagram illustrating an operation when canceling transmission of image data. In FIG. 26A, transmitted figures 2601 and 2602 are displayed. On the other hand, by the same operation as described above, a rectangular area partitioned by a broken line is displayed (FIG. 26B), and the graphic 2601 is selected (FIG. 26C). That is, the boundary of the graphic 2601 is displayed with a broken line, and the inside is displayed in gray.

In this display state, when the above-mentioned “key for changing the transmission state” is touched with the touch pen 110a, the vector information related to the transmitted graphic excluding the vector information related to the graphic 2501 is distributed to other PCs via the MFP 100. The As a result, the graphic 2601 is not displayed on other PCs.
In the PC 110, the boundary of the graphic 2601 is displayed with a solid line, and the inside is displayed in gray, thereby indicating that the transmission of the graphic 2601 is canceled and is not displayed on another PC.

In order to display the selected state more easily, for example, instead of the above-described display method, for example, a graphic in the selected state may be blinked.
(8) In the above embodiment, the case where image data is distributed to the PCs 110 to 113 using the MFP 100 has been described. However, the present invention is not limited to this, and image data using an apparatus other than the MFP is used. May be delivered. If the computer has a communication function, the above-described processing can be executed without using the MFP.

  Needless to say, the number of PCs that receive image data from the MFP 100 is not limited to four, and the effect of the present invention does not change even if the number of PCs is three or less, or five or more. This is the same even when a terminal device other than a PC is used.

  The terminal device, the relay device, the conference support system, and the program according to the present invention are useful as a technique for exchanging memos for conference materials among conference attendees.

DESCRIPTION OF SYMBOLS 1 ............... Conference support system 100 ............... Multifunctional peripheral apparatus 110-113 ... Personal computer 120 ............ Network 301,701 ... Communication control part 302,702 ... Received image management part 303 703: Image distribution management unit 304, 709 ... Rendering processing unit 305, 708 ... Layer image merging unit 306, 704 ... Input processing unit 307 ......... Print instruction receiving unit 308 ......... Display processing unit 309 ... ………… Image formation control unit 310 ...... …… Image management table 705 ……………… Coordinate acquisition unit 706 ……………… Handwritten drawing unit 707 ……………… Display processing unit 1601 ………… Handwriting Area 1602 .... Original image transmission key 1603 ..... Memo image transmission key 1604 ..... Input mode switching key 1605 ..... Transmission mode switching key

Claims (11)

A terminal device included in a conference support system in which a plurality of terminal devices are connected to a network,
An accepting means for accepting data written in the conference material from the user;
Receiving means for receiving data written in the conference material from another terminal device;
Synthesizing means for generating synthesized data by synthesizing own data that is data received by the accepting means and other data that is data received by the receiving means;
Display means for displaying the composite data;
When receiving a transmission instruction from the user, it comprises a transmission means for transmitting its own data to another terminal device,
The synthesizing unit uses the latest other data for each other terminal device among the other data received by the receiving unit for synthesizing with the own data. The terminal device according to claim 1, wherein the display unit displays, in a different manner, a portion of the own data that has already been transmitted by the transmission unit and a portion that has not yet been transmitted. In addition to its own data and other data, the synthesizing means further synthesizes the conference material data for displaying the conference material,
The terminal device according to claim 1, wherein the receiving unit receives data using a touch panel disposed on a display surface of the display unit. The terminal device according to claim 1, wherein the transmission unit compresses the own data and transmits the compressed data to another terminal device. The receiving means receives data from other terminal devices via the relay device,
The terminal device according to claim 1, wherein data from another terminal device is combined into one data by a relay device. In a conference support system in which a plurality of terminal devices are connected to a network, a relay device that relays data written to a conference material that is transmitted and received between the plurality of terminal devices,
Receiving means for receiving data from the terminal device;
Combining means for combining received data;
Transmission means for transmitting the combined data to the terminal device,
A combining device synthesizes data received from a terminal device other than the terminal device that is a transmission destination of the combined data. A recording means for recording meeting material data for displaying the meeting material;
The relay apparatus according to claim 6, wherein the transmitting unit transmits the conference material data together with the data combined by the combining unit. The relay apparatus according to claim 6, further comprising a printing unit configured to synthesize and print the data synthesized by the synthesizer and the conference material data. A conference support system including a plurality of terminal devices and a relay device that relays data transmitted and received between the plurality of terminal devices, the data being written to the conference material,
Each terminal device
Receiving means for receiving data from the user;
First receiving means for receiving data from the relay device;
First synthesizing means for generating synthesized data by synthesizing own data which is data received by the accepting means and other data which is data received by the receiving means;
Display means for displaying the composite data;
When receiving a transmission instruction from the user, the first transmission means for transmitting its own data to another terminal device,
The first combining means combines only the latest other received data,
The relay device
Second receiving means for receiving data from the terminal device;
A second combining means for combining the received data;
Second transmission means for transmitting the combined data to the terminal device,
The meeting support system, wherein the second combining means combines the latest data received from a terminal device other than the terminal device that is a transmission destination of the combined data. A program executed by a terminal device included in a conference support system in which a plurality of terminal devices are connected to a network,
A reception step for receiving data to be written in the conference material from the user;
A receiving step of receiving data written in the conference material from another terminal device;
A synthesizing step of generating synthesized data by synthesizing own data that is data received in the accepting step and other data that is data received in the receiving step;
A display step for displaying the composite data;
When receiving a transmission instruction from the user, including a transmission step of transmitting own data to another terminal device,
The synthesizing step synthesizes the latest other data for each other terminal device among the other data received in the receiving step. In a conference support system in which a plurality of terminal devices are connected to a network, a program that is executed by a relay device that relays data written to a conference material that is transmitted and received between the plurality of terminal devices,
A receiving step of receiving data from the terminal device;
A synthesis step for synthesizing the received data;
Transmitting the synthesized data to the terminal device, and
The synthesis step synthesizes data received from a terminal device other than the terminal device that is a transmission destination of the synthesized data.

Images