WO2013141280A1

WO2013141280A1 - Conference assistance system, program and conference assistance method

Info

Publication number: WO2013141280A1
Application number: PCT/JP2013/058006
Authority: WO
Inventors: ズルキフリービンハムザームハマド; 近藤　義之
Original assignee: ブラザー工業株式会社
Priority date: 2012-03-22
Filing date: 2013-03-21
Publication date: 2013-09-26
Also published as: JP2013198038A

Abstract

A conference assistance device is provided with a detection means, an assessment means and a sending means. In a state in which a first content image based on content data is displayed on a first display section connected to the conference assistance device, the detection means detects coordinate information for an operation performed via an operation section connected to the conference assistance device. On the basis of the coordinate information detected by the detection means, the assessment means assesses whether a given operation that identifies a position in the first content image has been performed. If the assessment means assesses that the given operation has been performed, the sending means sends a content notification to a display device, said content notification containing information that indicates the first content image displayed on the first display section.

Description

CONFERENCE SUPPORT SYSTEM, PROGRAM, AND CONFERENCE SUPPORT METHOD

This disclosure relates to a conference support system, a conference support device, and a conference support method for supporting a conference held between a presenter and a student by displaying presentation materials on terminals used by the presenter and the student.

A conference support system has been proposed in which presentation materials are displayed on the terminals used by the presenter and students, thereby supporting the conference and the like that the presenter gives to the students in a presentation format. In the conference support system, the presentation material that the presenter refers to at the time of presentation is displayed on the terminal used by the student. The displayed presentation material is updated in conjunction with the presentation contents of the presenter. Therefore, the student can easily refer to the presentation material related to the presentation contents. In Patent Literature 1, the presentation material displayed on the terminal is updated in conjunction with the presenter's presentation content (shared mode) and the presenter's presentation content is updated independently of the presenter's presentation content (shared mode). A technique capable of switching between the independent mode is disclosed. In the independent mode, the presentation material displayed on the terminal is updated according to the input operation by the student, so that the student can display the desired presentation material on the terminal even during the meeting. it can.

JP 2000-92217 A

However, when the system operates in the independent mode, the presentation material displayed on the terminal is updated according to the input operation by the student, so that the presenter can display the presentation material to be emphasized on the student's terminal. Can not. Therefore, there is a problem that the presenter cannot make the student recognize the desired presentation material.

The purpose of this disclosure is to display a presentation material desired by the student on the terminal, and when there is a presentation material that the presenter wants to emphasize, a conference support system capable of displaying the presentation material on the terminal, A conference support apparatus and a conference support method are provided.

A conference support system according to a first aspect of the present disclosure is a conference support system including a conference support device and a display device, and the conference support device includes a document on a first display unit connected to the conference support device. Detection means for detecting coordinate information of an operation performed via the operation unit connected to the conference support apparatus in a state where the first material image based on the data is displayed, and the coordinate information detected by the detection means And determining means for determining whether or not a predetermined operation for specifying a position on the first material image has been performed; and when the determination means determines that the predetermined operation has been performed, Transmission means for transmitting a material notification including information indicating the first material image displayed on the display unit to the display device, wherein the display device distributes the material data distributed in advance from the conference support device. On the second display unit connectable to the display device in synchronization with the first material image displayed on the first display unit, and an operation unit connected to the display device Selected from the operation mode setting means for setting one of the second mode in which the second material image based on the material data is displayed on the second display unit, and is transmitted from the conference support device. A receiving means for receiving the material notification; and when the material notification is received by the receiving means in the state set in the second mode, the first material image indicated by the material notification is displayed in the first mode. In place of the two material images, display control means for displaying on the second display unit together with a display corresponding to the predetermined operation is provided.

According to the first aspect, the conference support device transmits a material notification to the display device when a predetermined operation is performed via the operation unit. The display device displays the material image notified by the material notification received from the conference support device on the second display unit. A user (for example, a presenter) who uses the conference support apparatus can make a presentation or the like while showing a desired document image to a user (for example, a student) who uses the display device.

In the conference support system, even when the display device is operating in an operation mode in which the document image displayed on the second display unit is updated independently of the document image displayed on the first display unit, When the device receives the material notification, the same material image as the material image displayed on the first display unit is displayed on the second display unit. For this reason, the conference support system displays the document image desired by the student on the second display unit of the display device, and when the presenter performs a predetermined operation on the conference support device, the first display unit It is possible to display the same material image as the material image displayed on the second display unit.

Furthermore, since the document image is displayed on the second display unit in a manner indicating that the predetermined operation has been performed, the student can select a specific part of the document image by the presenter performing the predetermined operation. You can easily recognize what you specified.

In the first aspect, the transmission means further transmits position information indicating a specific position, which is a position on the first material image specified by the predetermined operation, to the display device, and the reception means includes the conference The position information transmitted from the support device is further received, and the display control unit displays a specific image indicating the specific position indicated by the position information when the position information is received by the receiving unit. You may display on said 2nd display part as a display corresponding to operation. For example, the presenter specifies a part to be particularly emphasized in the document image by a predetermined operation. On the second display unit, a specific image indicating a part specified by a predetermined operation is displayed. Therefore, the student can easily identify and recognize the part that the presenter wants to emphasize from the document image. In this way, the conference support system can improve the convenience when the presenter makes a presentation or the like with reference to the material image.

In the first aspect, the detection means detects a trajectory of movement of the operation unit specified based on a change with time of the coordinate information, and the determination means is based on the trajectory detected by the detection means. It may be determined whether the predetermined operation has been performed. The conference support apparatus can determine that a general emphasis operation performed by the presenter using the operation unit is a predetermined operation for specifying a part on the document image. For this reason, the presenter can easily make the student recognize the part of the document image to be particularly emphasized by performing the highlighting operation as usual on the part of the document image to be particularly emphasized.

In the first aspect, the determination unit may determine whether the predetermined operation has been performed based on a total distance of the trajectory per predetermined time. This is because the degree of emphasis by the presenter tends to increase as the total distance of the movement locus of the operation unit increases. Therefore, the conference support apparatus can determine a predetermined operation more accurately.

In the first aspect, the determination means may determine whether or not the predetermined operation has been performed based on a change direction of a traveling direction vector specified based on the trajectory. This is because the degree of emphasis by the presenter tends to increase as the change mode of the traveling direction vector increases. Therefore, the conference support apparatus can determine a predetermined operation more accurately.

In the first aspect, when the determination unit includes at least one position of a character and a graphic included in the first material image in an area indicated by the locus detected by the detection unit, It may be determined that the predetermined operation has been performed. As a result, the conference support apparatus can more accurately determine a predetermined operation.

In the first aspect, the display device sets a volume level of a speaker connected to the display device in response to the material notification being received by the receiving unit in the state set in the second mode. You may further provide the volume adjustment means to make it increase rather than before a document notification is received. According to this, it can notify that it replaced with the 2nd material image and the 1st material image was displayed.

In the first aspect, whether or not the display device accepts an input to the first material image displayed on the second display unit by the display control unit via an operation unit connected to the display device. An additional determination means for determining whether or not the additional determination means has received an input to the first material image, and a state set to the first mode from a state set to the second mode And a mode changing means for changing to the above.

In the first aspect, the display device displays the second display unit displayed on the second display unit by the display control unit in response to determining that the additional determination unit has not received an input to the first material image. Instead of one material image, a display restoring means for displaying the second material image on the second display unit may be further provided.

A program according to a second aspect of the present disclosure is a program executable by a computer that controls the display device connectable to a conference support system including a conference support device and a display device, the computer supporting the conference support First displaying material data distributed in advance from the device on the second display unit connectable to the display device in synchronization with the first material image displayed on the first display unit connected to the conference support device An operation for setting one of a mode and a second mode in which a second material image based on the material data selected through the operation unit connected to the display device is displayed on the second display unit Mode setting means, receiving means for receiving the material notification transmitted from the conference support device, and the receiving means in the state set in the second mode, When a material notification including information is received, the first material image is replaced with the second material image, and a predetermined position for identifying a position on the first material image performed by the conference support device is specified. It is made to function as a display control means for displaying on the second display unit together with a display corresponding to the operation. According to the 2nd aspect, there can exist an effect similar to a 1st aspect.

A program according to a third aspect of the present disclosure is a program that can be executed by a computer that controls the conference support apparatus connectable to a conference support system including a conference support apparatus and a display device. Detection for detecting coordinate information of an operation performed via the operation unit connected to the conference support device in a state where the first material image based on the material data is displayed on the first display unit connected to the support device Based on the coordinate information detected by the detection means, a determination means for determining whether a predetermined operation for specifying a position on the document image is performed, and the predetermined operation is performed by the determination means. A transmission means for transmitting a material notification including information indicating the first material image displayed on the first display unit to the display device when it is determined that To function. According to the 3rd aspect, there can exist an effect similar to a 1st aspect.

A conference support apparatus according to a fourth aspect of the present disclosure is the conference support apparatus connectable to a conference support system including a conference support apparatus and a display device, and the first display unit connected to the conference support apparatus A detection unit that detects coordinate information of an operation performed through an operation unit connected to the conference support device in a state where the first document image based on the document data is displayed; and the detection unit that detects the coordinate information Based on the coordinate information, a determination unit that determines whether a predetermined operation for specifying a position on the first material image has been performed; and when the determination unit determines that the predetermined operation has been performed, Transmission means for transmitting a material notification including information indicating the first material image displayed on the first display unit to the display device. According to the 4th aspect, there can exist an effect similar to a 1st aspect.

A conference support method according to a fifth aspect of the present disclosure is a conference support method executed by a conference support system including a conference support device and a display device, and the conference support device is connected to the conference support device. A detection step of detecting coordinate information of an operation performed via an operation unit connected to the conference support device in a state where the first material image based on the material data is displayed on the first display unit; and the conference support A determination step of determining whether a predetermined operation for specifying a position on the first material image has been performed based on the coordinate information detected by the detection unit; A transmission step of transmitting a material notification including information indicating the first material image displayed on the first display unit to the display device when it is determined by the means that the predetermined operation has been performed. And the display device synchronizes the material data distributed in advance from the conference support device with the first material image displayed on the first display portion on a second display portion connectable to the display device. Any one of the first mode for displaying and the second mode for displaying the second material image based on the material data selected on the operation unit connected to the display device on the second display unit An operation mode setting step for setting one of the above, a receiving step for the display device to receive the material notification transmitted from the conference support device, and the display device in the state set in the second mode. When the material notification is received by the receiving unit, the second table is displayed together with a display corresponding to the predetermined operation instead of the second material image, instead of the first material image indicated by the material notification. Comprising a display control step of displaying the part, the. According to the 5th aspect, there can exist an effect similar to a 1st aspect.

It is a figure which shows the outline | summary of the meeting assistance system 1, and the electrical structure of the meeting assistance apparatus 11 and the display apparatus 15. FIG. It is a figure which shows the display screen 371 displayed on the display part 37 of the meeting assistance apparatus 11. FIG. 7 is a diagram showing a display screen 471 displayed on the display unit 47 of the display device 15. FIG. It is a flowchart which shows a start process. It is a flowchart which shows an addition process. It is a flowchart which shows a detection process. It is a figure which shows the display screen 371 displayed on the display part 37 of the meeting assistance apparatus 11. FIG. It is a figure for demonstrating the detection method of predetermined | prescribed operation. It is a flowchart which shows a transmission process. 6 is a diagram showing data stored in a packet 61. FIG. It is a flowchart which shows a reception process. 7 is a diagram showing a display screen 471 displayed on the display unit 47 of the display device 15. FIG. 7 is a diagram showing a display screen 471 displayed on the display unit 47 of the display device 15. FIG.

The conference support system 1 will be described with reference to FIG. The conference support system 1 includes a conference support device 11 and

display devices

12, 13, and 14 (hereinafter collectively referred to as “display device 15”). The conference support device 11 and the display device 15 are connected to be communicable via the network 20. The conference support system 1 supports a conference or the like that is performed by the presenter in a presentation format for the students. The meeting support device 11 is used by a presenter, and the display device 15 is used by a student. The presenter proceeds with the presentation-style conference while referring to the material image displayed on the display unit 37 of the conference support apparatus 11. The student attends the presenter's presentation while referring to the material image displayed on the display unit 47 of the display device 15. As a specific example of the meeting support device 11 and the display device 15, a well-known PC (Personal Computer) can be cited.

The display device 15 can operate in two operation modes (first mode and second mode). When the display device 15 operates in the first mode, the material image of the same page as the material image for one page displayed on the display unit 37 of the conference support device 11 is also displayed on the display unit 47 of the display device 15. . Further, when the page of the document image displayed on the display unit 37 of the conference support apparatus 11 is updated, the page of the document image displayed on the display unit 47 of the display apparatus 15 is also updated at the same timing. As described above, when the display device 15 operates in the first mode, the document image of the same page as the document image page that the presenter refers to via the display unit 37 is also displayed on the display unit 47 of the display device 15. Will be. Accordingly, the student can easily refer to the material image that the presenter refers to at the time of presentation.

On the other hand, when the display device 15 operates in the second mode, the material image of the page specified according to the input operation by the student is displayed on the display unit 47. Unlike the case of operating in the first mode, the page of the material image displayed on the display unit 47 of the display device 15 and the page of the material image displayed on the display unit 37 of the conference support device 11 are not linked. For this reason, when the display device 15 operates in the second mode, the student can refer to the material image of the desired page even during the presentation by the presenter.

The display screens displayed on the

display units

37 and 47 will be described as examples. FIG. 2 shows a display screen 371 that is an example of a display screen displayed on the display unit 37 of the conference support apparatus 11. The display screen 371 is provided with a first area 3711 to a fourth area 3714. A toolbar is displayed in the first area 3711. In the second area 3712, names of students who participate in the conference (such as “TARO” and “JIRO”) are displayed. In the third area 3713, a document image for one page is displayed. In the fourth area 3714, three selection buttons ("material image", "return", and "forward") are displayed.

When the presenter starts a presentation-style meeting, the presenter selects one of a plurality of files stored in the HDD 34 (see FIG. 1, which will be described later) and including a plurality of pages of document images, Select “Document image”. The selected file is transmitted from the meeting support device 11 to the display device 15. The first page of the material image included in the selected file is displayed in the third area 3713. The presenter can advance the page of the document image displayed in the third area 3713 one page at a time by selecting the selection button “forward”. The presenter can restore the page of the document image displayed in the third area 3713 one page at a time by selecting the selection button “Return”.

FIG. 3 shows a display screen 471 which is an example of a display screen displayed on the display unit 47 of the display device 15. The display screen 471 is provided with a first area 4711 to a fourth area 4714. A toolbar is displayed in the first area 4711. In the second area 4712, an image showing the state of the presenter taken by the camera 361 (see FIG. 1, described later) of the conference support apparatus 11 is displayed. A third region 4713 displays a one-page document image. In the fourth area 4714, four selection buttons (“first mode”, “second mode”, “return”, and “forward”) are displayed. The selection buttons “return” and “forward” are valid only when the second mode button is selected. Invalid when the first mode button is selected.

When the file transmitted from the meeting support device 11 is received by the display device 15, the display device 15 stores the file in the HDD 44 (see FIG. 1, described later). The student determines the operation mode of the display device 15 by selecting the selection button “first mode” or “second mode”. One page of the document image included in the file stored in the HDD 44 is displayed in the third area 4713 in a manner corresponding to the selected operation mode. When the selection button “first mode” is selected, the document image on the same page as the page of the document image displayed in the third area 3713 (see FIG. 2) of the display unit 37 of the conference support apparatus 11 is Displayed in three areas 4713. When the page of the document image displayed in the third area 3713 is changed, the page of the document image displayed in the third area 4713 is also automatically updated. On the other hand, when the selection button “second mode” is selected, the material image of the page designated by the student's input operation is displayed in the third area 4713. The student can advance the page of the document image displayed in the third area 4713 one page at a time by selecting the selection button “forward”. In addition, the student can restore the page of the document image displayed in the third area 4713 by one page by selecting the selection button “Return”.

Also, the student can recognize the state of the presenter by viewing the video displayed in the second area 4712. Although details will be described later, the display device 15 outputs sound from the speaker 48 in accordance with sound data based on the sound of the presenter collected by the microphone 39 (see FIG. 1) of the conference support device 11. The sound output from the speaker 48 is output at a volume corresponding to the volume level stored in the RAM 43 (described later). Therefore, the student can listen to the voice uttered by the presenter.

In the present embodiment, the display device 15 is in a state of operating in the second mode when a predetermined operation is performed via the mouse 362 (see FIG. 1) connected to the conference support device 11. The document image of the same page as the page of the document image displayed on the display unit 37 of the conference support apparatus 11 is displayed on the display unit 47. Further, the display device 15 displays the document image for one page on the display unit 47 in such a manner that the student can recognize a part designated by a predetermined operation among the document images for one page as necessary. Thereby, the display device 15 can make the student surely recognize the page of the document image that the presenter particularly wants to emphasize and the specific part in the document image. As described above, the conference support system 1 can smoothly advance the conference in the presentation format by the presenter.

The electrical configuration of the conference support apparatus 11 will be described with reference to FIG. The conference support apparatus 11 includes a CPU 31 that controls the conference support apparatus 11. The CPU 31 includes a ROM 32, a RAM 33, a hard disk drive (HDD) 34, a communication I / F 35, an external interface (hereinafter referred to as “external I / F”) 36, a display unit 37, a speaker 38, a microphone 39, and a drive device 40. Connect electrically. The ROM 32 stores a boot program, BIOS, and the like. The RAM 33 stores timers, counters, and temporary data. The CPU 31 stores the time acquired by using the time measuring function of the OS in the RAM 33 as a timer. This storage of the timer is periodically performed in a sufficiently short cycle as compared with the unit time in the detection process shown in FIG. The RAM 33 stores a participant table (described later). The HDD 34 stores a control program for the CPU 31. The HDD 34 stores a plurality of files including a plurality of pages of document images. The communication I / F 35 communicates with the display device 15 via the network 20. A camera 361 and a mouse 362 are connected to the external I / F 36. The drive device 40 reads information stored in the storage medium 401. For example, when the conference support apparatus 11 is set up, the control program stored in the storage medium 401 is read by the drive apparatus 40 and stored in the HDD 34. Alternatively, a control program stored in an HDD of an external download server (not shown) may be downloaded via the communication I / F 35. The downloaded control program is stored in the HDD 34.

The electrical configuration of the display device 15 will be described. The display device 15 includes a CPU 41 that controls the display device 15. The CPU 41 is electrically connected to the ROM 42, RAM 43, HDD 44, communication I / F 45, external I / F 46, display unit 47, speaker 48, and drive device 50. The ROM 42 stores a boot program, BIOS, and the like. The RAM 43 stores temporary data such as a timer, a counter, and a volume level. The HDD 44 stores a control program for the CPU 41. Further, the HDD 44 stores a file including a plurality of pages of document images and received from the conference support apparatus 11. The communication I / F 45 communicates with the conference support apparatus 11 via the network 20. A mouse 461 is connected to the external I / F 46. The drive device 50 reads information stored in the storage medium 501. For example, when the display device 15 is set up, the control program stored in the storage medium 501 is read by the drive device 50 and stored in the HDD 44. Alternatively, a control program stored in an HDD of an external download server (not shown) may be downloaded via the communication I / F 45. The downloaded control program is stored in the HDD 44.

Processing executed by the CPU 31 of the conference support apparatus 11 (start processing, addition processing, detection processing, and transmission processing) will be described with reference to FIGS. The CPU 31 executes a plurality of processes in parallel. It is assumed that the CPU 31 has received a request for participation in the conference from the display device 15 before the processing is started. CPU31 memorize | stores the address (MAC address and IP address) of the transmission origin of the received participation request in a participant table as an address of the display apparatus 15 which transmitted the participation request. The address is associated with the ID of the display device 15 that has transmitted the participation request. CPU31 grasps the display apparatus 15 which the student who participates in a meeting uses by a participant table.

The start process will be described with reference to FIG. When one of a plurality of files stored in the HDD 34 is selected by the presenter and the selection button “document image” displayed in the fourth area 3714 of the display screen 371 is selected by the presenter, the CPU 31 Start processing is started.

CPU31 judges whether the display apparatus 15 which the student who has participated in the meeting uses exists based on a participant table (S11). When one or more IDs and addresses are stored in the participant table, the CPU 31 determines that there is a display device 15 used by the students participating in the conference (S11: YES). The CPU 31 acquires all addresses stored in the participant table (S13). The CPU 31 transmits the file selected by the presenter to the acquired address (S15). The start process ends. On the other hand, when the ID and the address are not stored in the participant table, the CPU 31 determines that there is no display device 15 used by the student participating in the conference (S11: NO). In this case, the start process ends.

The addition process will be described with reference to FIG. When the CPU 31 newly receives a participation request from the display device 15 not participating in the conference during the conference, the CPU 31 starts an additional process.

The CPU 31 determines whether an arbitrary page of the material image included in the file transmitted in S15 (see FIG. 4) is displayed in the third area 3713 of the display screen 371 (S21). When an arbitrary page of the document image is displayed in the third area 3713 (S21: YES), the CPU 31 stores the ID and address of the display device 15 that has transmitted the participation request in association with each other in the participant table. Next, the CPU 31 acquires an address newly stored in the participant table (S23). The CPU 31 transmits a file including a document image for one page displayed in the third area 3713 to the acquired address (S25). The addition process ends. On the other hand, if any page of the document image is not displayed in the third area 3713 (S21: NO), the addition process ends.

The detection process will be described with reference to FIG. The CPU 31 acquires the movement amount continuously output from the mouse 362, and repeatedly calculates the relative position of the mouse 362. The CPU 31 periodically executes a detection process to determine whether a predetermined operation has been performed on the mouse 362 based on the relative position of the mouse 362 calculated per unit time.

The predetermined operation is an operation performed by the presenter using the mouse 362 in order to emphasize a specific part of the document image for one page displayed in the third area 3713. For example, as shown in FIG. 7, the mouse 362 moves the cursor 372 back and forth on the “Presentation Material” character 373 among the one-page document images displayed in the third area 3713 as shown in FIG. Is operated. A locus 375 indicates a locus of movement of the cursor 372. Further, for example, it is assumed that the mouse 362 is operated to draw a circle repeatedly with the cursor 372 on the character 374 of “page 1” in the document image. A locus 376 indicates the locus of movement of the cursor 372. These operations are general operations performed by the presenter when the

characters

373 and 374 are to be emphasized. The CPU 31 determines whether or not the presenter has performed an operation for emphasizing a specific part of the document image for one page by determining whether or not the above-described operation has been performed using the mouse 362.

Hereinafter, assuming that the mouse 362 is operated so that the cursor 372 moves within a unit time on the locus 51 shown in FIG. Hereinafter, the movement locus 51 of the cursor 372 is referred to as “movement locus 51 of the mouse 362”. The left-right direction of the third region 3713 and the left-right direction in FIG. 8 are the X-axis direction, and the up-down direction of the third region 3713 and the up-down direction in FIG.

As shown in FIG. 6, the CPU 31 specifies a plurality of coordinate information (X, Y) indicating the relative position of the mouse 362 based on the movement amount continuously output from the mouse 362. When a predetermined operation is performed on the mouse 362, the CPU 31 specifies a plurality of pieces of coordinate information (X, Y) indicating positions on the locus 51. The CPU 31 specifies the movement locus 51 of the mouse 362 based on the change with time of the coordinate information (X, Y) per unit time (S31). The unit time is measured by referring to a timer stored in the RAM 33 by the CPU 31 using the time measuring function of the OS. The CPU 31 calculates the movement region 52 (see FIG. 8) of the mouse 362 based on the identified movement locus 51 (S33).

As shown in FIG. 8, among the plurality of specified coordinate information (X, Y), the minimum value (Xmin) and maximum value (Xmax) in the X-axis direction, and the minimum value (Ymin) in the Y-axis direction and When the maximum value (Ymax) is set, the moving area 52 corresponds to an area surrounded by four points (Xmin, Ymin) (Xmax, Ymin) (Xmax, Ymax) (Xmin, Ymax).

As shown in FIG. 6, the CPU 31 calculates a movement range S (= Xmax−Xmin) (see FIG. 8) in the X-axis direction per unit time (S35). Next, the CPU 31 calculates the total distance T (see FIG. 8) of the trajectory 51 per unit time (S37).

CPU31 judges whether the total distance T calculated by S37 becomes 3 times or more of the movement range S calculated by S35 (S39). When the total distance T is less than three times the movement range S (S39: NO), the CPU 31 determines that a predetermined operation is not performed using the mouse 362. In this case, the detection process ends.

On the other hand, when the total distance T is three times or more of the movement range S (S39: YES), the CPU 31 advances the movement locus 51 based on the movement locus 51 of the mouse 362 specified in S31 (see FIG. 8). The direction vector is specified, and the number of times the polarity of the X-axis direction component of the specified traveling direction vector changes is calculated (S41). As shown in FIG. 8, the trajectory 51 reciprocates a total of three times in the X-axis direction. The polarity changes three times from positive (right direction in FIG. 8) to negative (left direction in FIG. 8), and the polarity changes twice from negative to positive. Therefore, 5 (= 3 + 2) is calculated as the number of changes in polarity.

As shown in FIG. 6, the CPU 31 determines whether the calculated number of changes in polarity is 3 or more (S43). In the case of the trajectory 51 of FIG. 8, since 5 is calculated (S43: YES), the process proceeds to S45. On the other hand, when the calculated number is less than 3 (S43: NO), the CPU 31 determines that the predetermined operation is not performed using the mouse 362. In this case, the detection process ends.

In S45, the CPU 31 determines whether at least one of characters and figures included in the one-page document image displayed in the third area 3713 is included in the moving area 52 specified in S33 (S45). ). In the case of FIG. 8, the character 53 of “presentation material” is included in the movement area 52 (S45: YES). In this case, the CPU 31 recognizes that a predetermined operation, that is, an operation for emphasizing a specific part of one page of the document image displayed in the third area 3713 has been performed using the mouse 362 (S47). ). The CPU 31 stores the coordinate information ((Xmin, Ymin) (Xmax, Ymin) (Xmax, Ymax) (Xmin, Ymax)) indicating the movement area 52 specified in S33 in the RAM 33 as operation information ( S49). The detection process ends.

On the other hand, when neither a character nor a figure is included in the movement area 52 in S45 (S45: NO), the CPU 31 determines that a predetermined operation is not performed using the mouse 362. In this case, the detection process ends.

As described above, the CPU 31 can determine that the general emphasis operation performed by the presenter using the mouse 362 is a predetermined operation for designating a specific part on the document image. For this reason, the presenter can make the student easily recognize the portion of the document image to be particularly emphasized by performing a general enhancement operation on the portion of the document image to be particularly emphasized.

The CPU 31 determines whether a predetermined operation has been performed based on the total distance of the locus of movement 51 of the mouse 362. This is because the degree of emphasis by the presenter tends to increase as the total distance of the locus of movement of the mouse 362 increases. In addition, the CPU 31 determines whether a predetermined operation has been performed based on the number of times the polarity in the X-axis direction of the traveling direction vector of the movement locus 51 of the mouse 362 has changed. This is because the degree of emphasis by the presenter tends to increase as the number of changes in the polarity of the traveling direction vector increases. Therefore, the CPU 31 can more accurately and easily determine the emphasis operation performed by the presenter using the mouse 362.

Further, the CPU 31 determines that the presenter has performed a predetermined operation using the mouse 362 when the moving area 52 includes characters or line drawings. This is because the inventor usually emphasizes characters and line drawings and shows them to students. As a result, the CPU 31 can more accurately and easily determine the emphasis operation performed using the mouse 362.

The transmission process will be described with reference to FIG. CPU31 performs a transmission process periodically in order to transmit the packet 61 (refer FIG. 10) with respect to the display apparatus 15 periodically. The packet 61 stores video data indicating the appearance of the inventor, audio data of the inventor, and the like. The packet 61 stores data for controlling the mode of the display screen 471 displayed on the display screen 471 of the display device 15. Details are as follows.

As shown in FIG. 10, the packet 61 stores a packet number 611, a destination address 612, video data 613, audio data 614, an operation type 615, a file name 616, a page number 617, and a movement area 618. The packet number 611 is an identification number for identifying the packet 61. The destination address 612 is the address of the destination display device 15 to which the packet 61 is transmitted. The video data is video data showing the presenter taken by the camera 361 (see FIG. 1) connected to the conference support apparatus 11 (see FIG. 1). The voice data is voice data of the presenter collected by a microphone 39 (see FIG. 1) provided in the conference support apparatus 11.

The operation type 615 is information indicating the type of operation performed by the presenter. Any one of the three types is stored in the packet 61 as the operation type 615. The first is “page switching” indicating that an operation for switching the page of the document image has been performed. “Page switching” is stored as the operation type 615 when an operation of selecting the selection buttons “return” and “forward” provided in the fourth area 3714 of the display screen 371 is executed by the presenter. The second is a “predetermined operation” indicating that a predetermined operation has been performed using the mouse 362. “Predetermined operation” was performed by the presenter using the mouse 362 to emphasize a specific part of the document image for one page displayed in the third area 3713 of the display screen 371. In this case, the operation type 615 is stored. The third is “other” indicating that an operation other than “page switching” and “predetermined operation” has been performed by the inventor.

The file name 616 is a name of a file including a one-page material image displayed in the third area 3713. The page number 617 is a number indicating the page of the material image displayed in the third area 3713. The movement area 618 is coordinate information of four points indicating the movement area 52 (see FIG. 8) specified in S33 (see FIG. 6).

As shown in FIG. 9, the CPU 31 acquires operation information when the movement area 52 is stored as operation information in the RAM 33 in S49 of the detection process (see FIG. 6) (S61). The CPU 31 creates a packet 61 (see FIG. 10) to be transmitted to the display device 15 as follows. The CPU 31 stores identification information for identifying the packet 61 in the packet 61 as a packet number 611 (see FIG. 10). The CPU 31 acquires all the addresses stored in the participant table and stores them in the packet 61 as the destination address 612 (see FIG. 10). The CPU 31 acquires an image showing the state of the inventor taken by the camera 361 from the camera 361. The CPU 31 stores the acquired video data in the packet 61 as video data 613 (see FIG. 10). The CPU 31 acquires the voice of the inventor collected by the microphone 39 from the microphone 39. The CPU 31 stores the acquired audio data in the packet 61 as audio data 614 (see FIG. 10) (S63).

The CPU 61 selects the “Return” and “Forward” selection buttons displayed in the fourth area 3714 of the display screen 371, and performs an operation of switching the page of the document image for one page displayed in the third area 3713. (S65). When the operation for switching the page of the document image is performed (S65: YES), the CPU 31 stores “page switching” as the operation type 615 in the packet 61. The CPU 31 stores the name of the file including the one-page material image displayed in the third area 3713 as the file name 616 in the packet 61. The CPU 31 stores a number indicating the page of the document image newly displayed in the third area 3713 when the selection buttons “return” and “forward” are selected in the packet 61 as the page number 617 ( S67). With the above processing, the creation of the packet 61 is completed. The CPU 31 transmits the created packet 61 to the destination address 612 (S75). The transmission process ends.

On the other hand, when neither of the selection buttons “return” and “forward” is selected (S65: NO), the CPU 31 determines whether or not the operation information has been acquired from the RAM 33 in S61 (S69). When the operation information can be acquired (S69: YES), the moving area 52 (see FIG. 8) is stored in the RAM 33 as the operation information in S49 (see FIG. 6). In this case, the CPU 31 determines that a predetermined operation is being performed via the mouse 362. The CPU 31 stores “predetermined operation” as the operation type 615 in the packet 61. The CPU 31 stores the name of the file including the one-page material image displayed in the third area 3713 as the file name 616 in the packet 61. The CPU 31 stores the number indicating the page of the document image displayed in the third area 3713 in the packet 61 as the page number 617. The CPU 31 stores the coordinate information of the four points indicating the movement area 52 acquired in S61 in the packet 61 as the movement area 618 (S71). Thus, the creation of the packet 61 is completed. The CPU 31 transmits the created packet 61 to the destination address 612 (S75). The transmission process ends.

On the other hand, when the operation information cannot be acquired from the RAM 33 in S61, the CPU 31 determines that a predetermined operation using the mouse 362 is not performed (S69: NO). The CPU 31 stores “other” as the operation type 615 in the packet 61, and the creation of the packet 61 is completed. The CPU 31 transmits the created packet to the destination address 612 (S75). The transmission process ends.

The reception process executed by the CPU 41 of the display device 15 will be described with reference to FIG. Note that the CPU 41 transmits a participation request to the conference support apparatus 11 in order to request the conference support apparatus 11 to participate in the conference before the process is started. Further, the CPU 41 receives the file (S15, see FIG. 4) (see S25, FIG. 5) transmitted from the conference support apparatus 11, and stores it in the HDD 44. A student who uses the display device 15 is one of the selection buttons “first mode” and “second mode” displayed in the fourth area 4714 (see FIG. 3) of the display screen 471 (see FIG. 3). Is selected via the mouse 361. Information indicating one of the “first mode” and “second mode” is stored in the RAM 43. The CPU 41 operates in the selected operation mode (first mode or second mode), thereby displaying one page of document images of the plurality of document images included in the file stored in the HDD 44 on the display screen 471. This is displayed in the third area 4713 (see FIG. 3).

The CPU 41 receives the packet 61 (see FIG. 10) transmitted from the conference support apparatus 11 (S75, see FIG. 9) (S101). The CPU 41 acquires the operation type 615 stored in the received packet 61. It is assumed that “page switching” is acquired as the operation type 615 (S103: YES). In this case, in the conference support apparatus 11, the selection buttons “return” and “forward” displayed in the fourth area 3714 of the display screen 371 are selected by the inventor. Thereby, in the meeting support apparatus 11, the page of the material image displayed in the third area 3713 is updated. The CPU 41 acquires the file name 616 and page number 617 stored in the received packet 61 (S105).

The CPU 41 refers to the RAM 43 and determines whether the display device 15 is operating in the first mode (S107). In the first mode, the material image of the same page as the material image page displayed on the display unit 37 of the conference support apparatus 11 is displayed on the display unit 47 of the display device 15. When the CPU 41 determines that the display device 15 is operating in the first mode (S107: YES), the CPU 41 reads out and acquires the file with the file name 616 acquired in S105 from the HDD 44. CPU41 extracts the material image of the page number 617 acquired by S105 out of the acquired file, and displays it on the 3rd area | region 4713 of the display screen 471 (S109). The CPU 41 acquires video data 613 and audio data 614 stored in the packet 61 received in S101. The CPU 41 displays a material image (see S109) and at the same time displays a video in the second area 4712 of the display screen 471 based on the acquired video data 613. The CPU 41 outputs a sound from the speaker 48 based on the acquired sound data 614 simultaneously with displaying the video. The reception process ends.

On the other hand, when the CPU 41 determines that the display device 15 is operating in the second mode (S107: NO), the CPU 41 does not update the document image for one page displayed in the third region 4713. The CPU 41 acquires the video data 613 from the packet 61 received in S101 and displays the video in the second area 4712 of the display screen 471. The CPU 41 acquires the audio data 614 from the packet 61 received in S101 and outputs the audio from the speaker 48. The reception process ends.

Suppose that “predetermined operation” is acquired as the operation type 615 from the packet 61 received in S101 (S103: NO, S111: YES). In this case, the inventor uses the mouse 362 to specify a specific part of one page of the document image displayed in the third area 3713 (see FIG. 2) of the display screen 371 (see FIG. 2). The operation is performed. The CPU 41 acquires the file name 616, the page number 617, and the movement area 618 stored in the received packet 61 (S113).

The CPU 41 determines whether the display device 15 is operating in the first mode (S115). If it is determined that the display device 15 is operating in the first mode (S115: YES), the CPU 41 reads the file having the file name 616 acquired in S113 from the HDD 44 and acquires the file. CPU41 extracts the material image of the page number 617 acquired by S113 among the acquired files, and displays it on the 3rd area | region 4713 of the display screen 471 (S117). The CPU 41 highlights characters and line drawings placed inside the portion surrounded by the coordinate information of the four points indicated by the movement area 618 acquired in S113 in the document image for one page displayed in the third area 4713. (S118). As a specific mode of highlighting, for example, there is a highlight display.

For example, as shown in FIG. 7, it is assumed that a display screen 371 is displayed on the display unit 37 of the conference support apparatus 11. Then, it is assumed that the mouse 362 is operated such that the cursor 372 moves along the locus 375 on the character 373 of “presentation material” of the material image for one page displayed in the third area 3713. In this case, as shown in FIG. 12, the CPU 41 displays a document image of the same page as the page of the document image displayed in the third region 3713 (see FIG. 7) in the third region 4713 of the display screen 471 ( S117, see FIG. 11). Next, the CPU 41 sets the background color to the character 473 of “presentation material” included in the movement area specified based on the locus 375 (see FIG. 7) in one page of the document image displayed in the third area 4713. It is highlighted by adding 475 (S118, see FIG. 11). Note that the CPU 41 continues the highlighting until a predetermined time has elapsed from the start of the highlighting. After the predetermined time has elapsed, the CPU 41 cancels the highlight display.

Note that the highlighting mode is not limited to highlighting. For example, as illustrated in FIG. 7, it is assumed that the mouse 362 is operated such that the cursor 372 moves along the locus 376 on the character 374 of “page 1”. In this case, as shown in FIG. 12, the CPU 41 includes “page 1” included in the moving area specified based on the locus 376 (see FIG. 7) in the one-page document image displayed in the third area 4713. The character 474 may be highlighted by displaying it in a bold line.

The CPU 41 displays the data image for one page in the third area 4713 of the display screen 471, acquires the video data 613 from the packet 61 received in S101, and displays the video in the second area 4712. Further, the CPU 41 acquires the audio data 614 from the packet 61 received in S101 and outputs the audio from the speaker 48. The reception process ends.

On the other hand, assume that it is determined in S115 that the display device 15 is operating in the second mode (S115: NO). In the second mode, the document image of the page specified according to the input operation to the display device 15 by the student, except when a predetermined operation is performed using the mouse 362 connected to the conference support device 11 Is displayed on the display unit 47. However, in S <b> 111, “predetermined operation” is acquired from the packet 61 as the operation type 615. For this reason, the CPU 41 reads out and acquires the file having the file name 616 acquired in S113 from the HDD 44. CPU41 extracts the material image of the page number 617 acquired by S113 among the acquired files. The CPU 41 stores the name of the file including the document image displayed in the third area 4713 and the page number of the document image displayed in the RAM 43. The CPU 41 changes the document image being displayed in the third area 4713 to a document image for one page specified based on the received packet 61 and displays it (S119). As a result, the material image of the same page as the material image page displayed on the display unit 37 of the conference support apparatus 11 is displayed on the display unit 47 of the display device 15.

Next, as shown in FIG. 13, the CPU 41 paints out the first area 4711, the second area 4712, and the fourth area 4714 in the display screen 471 (see S121 and FIG. 11). Thereby, the CPU 41 notifies the student that the page of the document image displayed in the third area 4713 has been automatically changed even though the display device 15 is operating in the second mode. The CPU 41 acquires the video data 613 from the packet 61 received in S101, displays the material image (see S119), and simultaneously displays the video in the second area 4712. The CPU 41 acquires the audio data 614 from the packet 61 received in S101, displays the video, and outputs the audio from the speaker 48 at the same time.

As shown in FIG. 11, the CPU 61 increases the volume level of the sound output from the speaker 48 as compared to before the “predetermined operation” is acquired as the operation type 615 (S123). At this time, the volume level before the increase is temporarily stored in the RAM 43. In step S123, the student can be notified that the page of the material image displayed in the third area 4713 has been automatically changed even though the display device 15 is operating in the second mode. it can. The CPU 41 invalidates the selection buttons “return” and “forward” displayed in the fourth area 4714 (S125). The reason is that although the display device 15 is operating in the second mode, the document image of the same page as the document image page displayed on the display unit 37 of the conference support device 11 is displayed in the third region 4713. This is because the student cannot manually update the document image page.

The CPU 41 determines whether an operation for selecting one page of the document image displayed in the third area 4713 using the mouse 461 (see FIG. 1) has been performed (S127). When an operation of selecting the currently displayed document image with the mouse 461 is performed within a predetermined time after the document image for one page is displayed in the third area 4713 in S119 (S127: YES), the CPU 41 displays The operation mode of the device 15 is changed to the first mode (S135). The reception process ends.

On the other hand, it is assumed that the elapsed time after the document image for one page is displayed in the third area 4713 in S119 is not less than a predetermined time in the state where the operation of selecting the currently displayed document image with the mouse 461 is not performed. (S127: NO). In this case, the CPU 41 reads from the RAM 43 the name of the file containing the document image before the display content is changed in S119 and the page number before the change. The CPU 41 displays, in the third area 4713, the material image having the read page number among the material images included in the read file. The CPU 41 restores the first area 4711, the second area 4712, and the fourth area 4714 filled in S121. The CPU 41 refers to the volume level before increase temporarily stored in the RAM 43, and restores the volume of the sound level increased in S123. The CPU 41 validates the selection buttons “return” and “forward” in the fourth area 4714 invalidated in S125. As a result, the CPU 41 restores the state of the display device 15 (S129). The reception process ends.

In S111, when “others” is acquired as the operation type 615 from the packet 61 received in S101 (S111: NO), the reception process ends.

As described above, the conference support apparatus 11 uses the mouse 362 to perform a predetermined operation, and the document image file name 616, page number 617, which is displayed in the third area 3713 of the display screen 371. Then, the area (moving area 618) on the material image designated by the predetermined operation is stored in the packet 61 and transmitted to the display device 15. The display device 15 displays the material image of the page specified by the page number 617 on the display unit 47 among the material images included in the file with the file name 616 notified by the packet 61 received from the conference support device 11. . A presenter who uses the conference support apparatus 11 can make a presentation or the like while showing a document image of a desired page to a student who uses the display device 15.

Even when the display device 15 is in the state of operating in the second mode, when a predetermined operation is performed on the conference support device 11, the material image displayed on the display unit 37 of the conference support device 11. The same document image is displayed on the display unit 47. For this reason, the student can be made to recognize the document image that the presenter particularly wants to emphasize to the student.

Further, the display device 15 can notify the student of a specific part on the material image designated by a predetermined operation by the presenter by highlighting. Therefore, the student can easily recognize a specific part on the material image emphasized by the presenter, and can easily grasp the points of the presenter's presentation contents.

Furthermore, the presenter performs a predetermined operation for designating a specific part on the document image, thereby displaying the same document image as the document image displayed on the display unit 37 of the conference support apparatus 11 on the display device 15. It can be displayed on the display unit 47. The predetermined operation is to operate the mouse 362 so that the cursor 372 repeatedly reciprocates in the vicinity of a specific part in the document image. For this reason, the presenter draws the student's attention to the part by indicating a specific part of the document image with the cursor 372, and the same material image as the material image displayed on the display unit 37 of the conference support apparatus 11 is displayed. The display of the display unit 47 can be switched so as to be displayed on the display unit 47 of the display device 15. For this reason, the presenter does not need to move the cursor 372 to a part other than a specific part (for example, a dedicated button for switching the display of the display unit 47 or the selection buttons “back” and “forward”). It is possible to switch the display of the display unit 47 while attracting the attention of the student at the site indicated by the cursor 372 in the image.

The CPU 31 that performs the process of S31 corresponds to the “detection means” of the present invention. The CPU 31 that performs the processing of S33 to S47 corresponds to the “determination means” of the present invention. The CPU 31 that performs the process of S75 corresponds to the “transmission means” of the present invention. The CPU 41 that performs the processing of S101 corresponds to the “reception unit” of the present invention. The CPU 41 that performs the processes of S117 and S119 corresponds to the “display control means” of the present invention. The process of S31 corresponds to the “detection step” of the present invention. The processing of S33 to S47 corresponds to the “determination step” of the present invention. The process of S75 corresponds to the “transmission step” of the present invention. The process of S101 corresponds to the “reception step” of the present invention. The processes of S117 and S119 correspond to the “display control step” of the present invention.

In addition, this invention is not limited to the above-mentioned embodiment, A various change is possible. In the above description, the CPU 31 determines whether a predetermined operation has been performed with the mouse 362. The predetermined operation may be performed by a device other than the mouse 362. For example, when a document image displayed on the display unit 37 of the conference support apparatus 11 is projected on the screen, when a specific part of the document image is designated by the laser pointer, the CPU 31 is assumed to have performed a predetermined operation. You may judge.

CPU31 may judge whether predetermined operation was performed by methods other than the method mentioned above. For example, the CPU 31 may determine that a predetermined operation has been performed when the mouse 362 is clicked. For example, the CPU 31 may determine whether a predetermined operation has been performed by photographing the position of the cursor 372 with a camera and specifying a locus of movement of the cursor 372 by image processing.

Various processes executed by the CPU 31 of the conference support apparatus 11 described above may be executed by another control apparatus (for example, MCU (Multi-point Control Unit)) connected to the network 20. The conference support apparatus 11 uses the file including the document image being displayed on the display unit 37, the page number, and the position information of the cursor 372, the video data captured by the camera 361, and the audio data collected by the microphone 39. Or the like may be transmitted to the control device. The control device may determine whether the presenter has performed a predetermined operation using the mouse 362 based on the position information of the cursor 372 received from the conference support device 11. The control device may identify the moving area 52 as necessary, store it in the packet 61, and transmit it to the display device 15. Thereby, the processing load of the meeting support apparatus 11 can be reduced.

The conference support device 11 and the display device 15 in the above may be switchable. That is, the display device 15 used by the person in charge of the presentation among those who participate in the conference may execute the process of the conference support device 11 described above.

In the above description, the CPU 31 determines whether a predetermined emphasis operation has been performed using the mouse 362 based on the total distance and the traveling direction vector of the movement locus 51 (see FIG. 8) of the mouse 362 (see FIG. 6). For example, the CPU 31 may determine the degree of enhancement by the enhancement operation according to the total distance and the number of changes in the polarity of the traveling direction vector. For example, the CPU 31 may determine that the degree of emphasis is greater as the total distance is greater. Further, for example, the CPU 31 may determine that the degree of enhancement is greater as the number of changes in the polarity of the traveling direction vector is greater. The CPU 31 may store information indicating the degree of emphasis in the packet 61 in addition to the moving area 52 and transmit the information to the display device 15 (see FIG. 9). The CPU 41 of the display device 15 may change the mode of highlighting based on information indicating the degree of highlighting (S118, see FIG. 11).

For example, when the display device 15 is operating in the first mode, the CPU 41 gradually brightens the background color 475 (see FIG. 12) or blinks the background color 475 as the degree of emphasis increases. In addition, the blinking cycle may be increased. Note that the number of blinks when the background color 475 is blinked may be synchronized with the total distance or the number of changes in the polarity of the traveling direction vector. For example, the CPU 41 may blink the background color 475 for the number of changes.

Further, when the display device 15 is operating in the second mode, the CPU 41 changes the color for filling the first region 4711, the second region 4712, and the fourth region 4714 depending on the degree of emphasis, or The filled portion may be blinked and the blinking cycle may be accelerated. Note that the number of blinks when blinking the filled portion may be synchronized with the number of changes in the total distance and the polarity of the traveling direction vector, as in the first mode.

The mode of highlighting when a predetermined operation is detected (see FIGS. 12 and 13) is not limited to the above-described embodiment. For example, the CPU 41 may perform highlighting by displaying an animation on the display screen 471. For example, highlighting may be performed by enclosing characters and line drawings included in the movement area with balloon lines of various shapes. Further, for example, the anthropomorphic character may be highlighted by taking a pose indicating a character or line drawing included in the moving area.

In the above-described embodiment, the highlighting is continued for a predetermined time and then released. The CPU 41 may change the duration of highlighting according to the degree of highlighting described above. For example, the CPU 41 may increase the duration of highlighting as the degree of emphasis increases.

Note that highlighting may be continued until the page of the document image being displayed is updated without being canceled. Furthermore, the user may be allowed to switch whether to cancel the highlighting after a predetermined time has elapsed.

1 Conference Support System 11 Conference Support Device 15

Display Devices

37, 47

Display Units

51, 375, 376 Trajectory 52

Movement Area

53, 373, 374, 473, 474 Character 61 Packet 362 Mouse

Claims

A conference support system including a conference support device and a display device,
The conference support device includes:
The coordinate information of the operation performed through the operation unit connected to the conference support device is detected in a state where the first material image based on the material data is displayed on the first display unit connected to the conference support device. Detecting means for
Determination means for determining whether a predetermined operation for specifying a position on the first material image has been performed based on the coordinate information detected by the detection means;
A transmission unit that transmits a material notification including information indicating the first material image displayed on the first display unit to the display device when the determination unit determines that the predetermined operation has been performed. And
The display device
A first mode in which the document data distributed in advance from the conference support device is displayed on a second display unit connectable to the display device in synchronization with the first document image displayed on the first display unit. And an operation mode for setting one of a second mode in which a second material image based on the material data is displayed on the second display unit, which is selected via an operation unit connected to the display device. Setting means;
Receiving means for receiving the material notification transmitted from the conference support device;
When the material notification is received by the receiving unit in the state set in the second mode, the predetermined operation is performed by replacing the first material image indicated by the material notification with the second material image. And a display control means for displaying on the second display unit together with a display corresponding to the above.
The transmission means includes
Position information indicating a specific position that is a position on the first material image specified by the predetermined operation is further transmitted to the display device;
The receiving means further receives the location information transmitted from the conference support device;
The display control means includes
When the position information is received by the receiving unit, a specific image indicating the specific position indicated by the position information is displayed on the second display unit as a display corresponding to the predetermined operation. The conference support system according to claim 1.
The detecting means detects a locus specified based on a change with time of the coordinate information,
The determination means includes
The conference support system according to claim 1, wherein it is determined whether the predetermined operation has been performed based on the locus detected by the detection unit.
The determination means includes
The conference support system according to claim 3, wherein it is determined whether the predetermined operation has been performed based on a total distance of the trajectory per predetermined time.
The determination means includes
5. The conference support system according to claim 3, wherein it is determined whether the predetermined operation has been performed based on a change mode of a traveling direction vector specified based on the trajectory.
The determination means includes
If the position indicated by the locus detected by the detecting means includes at least one position of characters and figures included in the first material image, it is determined that the predetermined operation has been performed. The meeting support system according to any one of claims 3 to 5, wherein
The display device
In response to reception of the material notification by the receiving means in the state set to the second mode, the volume level of a speaker connected to the display device is increased from before the material notification is received. Further comprising a volume control means
The conference support system according to any one of claims 1 to 6.
The display device
Additional determination means for determining whether or not an input has been received via the operation unit connected to the display device with respect to the first document image displayed on the second display unit by the display control unit;
Mode change means for changing from the state set to the second mode to the state set to the first mode in response to determining that the addition determination means has received an input to the first material image; The conference support system according to any one of claims 1 to 7, further comprising:
The display device
Instead of the first document image displayed on the second display unit by the display control unit in response to the determination that the addition determination unit has not received an input to the first document image, the second document image is displayed. The meeting support system according to claim 8, further comprising display restoration means for displaying a document image on the second display unit.
A computer-executable program for controlling the display device connectable to a conference support system including a conference support device and a display device,
The computer,
The material data distributed in advance from the conference support device is displayed on the second display unit connectable to the display device in synchronization with the first material image displayed on the first display unit connected to the conference support device. One mode selected from the first mode, and a second mode in which a second material image based on the material data selected through the operation unit connected to the display device is displayed on the second display unit. Operation mode setting means for setting;
Receiving means for receiving the material notification transmitted from the conference support device;
When a material notification including information indicating the first material image is received by the receiving means in the state set in the second mode, the first material image is replaced with the second material image, Display control means for displaying on the second display unit together with a display corresponding to a predetermined operation for specifying a position on the first document image performed by the conference support device;
Program to function as.
A computer-executable program for controlling the conference support device connectable to a conference support system including a conference support device and a display device,
The computer,
The coordinate information of the operation performed through the operation unit connected to the conference support device is detected in a state where the first material image based on the material data is displayed on the first display unit connected to the conference support device. Detecting means for
Determination means for determining whether a predetermined operation for specifying a position on the document image has been performed based on the coordinate information detected by the detection means;
A transmission unit that transmits a material notification including information indicating the first material image displayed on the first display unit to the display device when the determination unit determines that the predetermined operation has been performed. ,
Program to function as.
The conference support device connectable to a conference support system including a conference support device and a display device,
The coordinate information of the operation performed through the operation unit connected to the conference support device is detected in a state where the first material image based on the material data is displayed on the first display unit connected to the conference support device. Detecting means for
Determination means for determining whether a predetermined operation for specifying a position on the first material image has been performed based on the coordinate information detected by the detection means;
A transmission unit that transmits a material notification including information indicating the first material image displayed on the first display unit to the display device when the determination unit determines that the predetermined operation has been performed. When,
A meeting support apparatus.
A conference support method executed by a conference support system including a conference support device and a display device,
The conference support device was performed via an operation unit connected to the conference support device in a state where the first material image based on the material data was displayed on the first display unit connected to the conference support device. A detection step for detecting coordinate information of the operation;
A determination step in which the conference support apparatus determines whether a predetermined operation for specifying a position on the first material image has been performed based on the coordinate information detected by the detection unit;
When the conference support device determines that the predetermined operation has been performed by the determination unit, the material notification including the information indicating the first material image displayed on the first display unit is displayed on the display. A transmitting step for transmitting to the device;
The display device synchronizes the material data distributed in advance from the conference support device with the first material image displayed on the first display portion on a second display portion connectable to the display device. Either one of the first mode for displaying and the second mode for displaying the second material image based on the material data, which is selected through the operation unit connected to the display device, on the second display unit An operation mode setting step for setting
A receiving step in which the display device receives the material notification transmitted from the conference support device;
When the display device receives the material notification by the receiving means in the state set in the second mode, the first material image indicated by the material notification is replaced with the second material image. A display control step for displaying on the second display unit together with a display corresponding to the predetermined operation;
Meeting support method including