JP2004328588A - Multipoint conference system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a multipoint conference system for supporting smooth proceedings so that a meeting can be carried out smoothly, while significantly reducing the chairperson's burden. <P>SOLUTION: The multipoint conference system comprises a plurality of terminals located at different locations and a server 6 connected to the plurality of terminals via a communication line. The server 6 includes a database 22 for storing a proceedings schedule and a multipoint controller 20 for controlling the communication between the plurality of terminals. The server 6 controls the multipoint controller 20, based on the proceedings schedule and switches communication between the server 6 and the plurality of terminals. For example, the proceedings schedule includes authority information for differentiating the presenter terminal and the non-presenter terminals. Based on the authority information, the server 6 controls the multipoint controller 20 to grant the "right of operation" of announcement screen to a specific terminal from among the plurality of terminals. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a multipoint conference system for holding a conference using a plurality of terminals arranged at multiple points. In particular, the present invention relates to a conference progress support using a multipoint conference system.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, in a multipoint conference system in which a conference is performed by transmitting and receiving data such as voice, images, and / or conference materials between a plurality of terminals connected by a communication line, the conference participates under the moderation of a chair. Progress by giving presentations through their own terminals. When the presentation of one presenter is completed, the chair makes it possible for the next presenter to make a presentation on the presenter's terminal (so that the presentation contents created in advance by the next presenter are displayed on the display unit of another terminal). ), It is necessary to instruct the system via the chair's own terminal. The Chair is also responsible for reviewing the agenda schedule and advancing the meeting so that it ends within the scheduled time.
[0003]
Since the burden on the chairman is large as described above, a multipoint conference system having a function to support proceedings to reduce the burden has been proposed. For example, the system described in Patent Document 1 displays meeting time information by displaying on a screen of each terminal a pre-registered proceeding schedule and a bar graph indicating the elapsed time of each agenda item in the proceeding schedule. It informs the chairperson and meeting participants.
[0004]
[Patent Document 1]
JP-A-5-30506
[0005]
[Problems to be solved by the invention]
However, in such a multipoint conference system, although there is assistance in displaying the time, the chair needs to switch the presentation screen efficiently in order to proceed with the meeting efficiently. Was not enough.
[0006]
Therefore, an object of the present invention is to provide a multipoint conference system for supporting the proceedings so that a conference can proceed smoothly while greatly reducing the burden on the chairperson.
[0007]
[Means for Solving the Problems]
In order to achieve the above object, a multipoint conference system according to the present invention comprises:
In a multipoint conference system including a plurality of terminals arranged at different points and a server connected to the plurality of terminals via a communication line,
The server has a database storing the proceedings schedule, and a multipoint control unit for controlling communication between the plurality of terminals,
The server controls the multipoint control unit based on the proceedings schedule stored in the database, thereby switching communication between the server and the plurality of terminals.
[0008]
In such a multipoint conference system, communication between the server and each terminal is automatically switched based on a proceeding schedule indicating the role of each terminal at each time (for example, whether or not the terminal is used by the presenter), The burden on the chair can be greatly reduced, and as a result, the chair can run the meeting efficiently.
[0009]
The proceedings progress schedule includes first authority information for distinguishing between the chair terminal and the non-chair terminal,
Each terminal includes a selection unit for selectively displaying a screen for the chair or a screen for a non-chair on a display device,
The server may transmit a signal based on the first authority information to each terminal, and the selection unit of each terminal may cause the display device to display a screen for the chair or a screen for the non-chair based on the signal. Good.
[0010]
In this case, the multipoint conferencing system identifies whether each terminal connected to the server to participate in the conference is operated by the chair who conducts the conference or by a general participant other than the chair, and as a result, The screen for the chairman is automatically displayed on the display device of the terminal operated by the chair, and the screen for the non-chairperson (general participant) is automatically displayed on the display device of the terminal operated by the general participant. Therefore, any of the terminals can be used as a chair terminal or a general participant terminal, so that the convenience of the system is improved. Even if the chair changes in the middle of the meeting, if the contents are registered in the proceeding schedule in advance, the display screen is automatically switched, so that an efficient meeting can be performed.
[0011]
The proceeding schedule includes second authority information for distinguishing the presenter terminal from the non-presenter terminal,
The server may control the multipoint control unit based on the second authority information, thereby giving authority to a specific terminal among the plurality of terminals as a presenter terminal.
Here, the authority as a presenter terminal means that the presenter can operate the presentation screen commonly displayed on the display device of each terminal via the presenter terminal.
[0012]
In this case, since the operation right of the presentation screen is automatically switched, the burden on the chair can be greatly reduced.
[0013]
The proceeding schedule includes division information for dividing a plurality of devices into a plurality of groups,
The server may control the multipoint control unit based on the division information, thereby dividing the plurality of terminals into a plurality of groups.
Here, division into groups means that data such as image data is transmitted and received only between the groups.
[0014]
In this case, the division of the group is automatically performed, so that the chair does not need to issue a division instruction to the system, and as a result, the burden on the chair can be reduced.
[0015]
The split information includes third authority information for distinguishing a chair terminal and a non-chair terminal in each group,
Each terminal includes a selection unit for selectively displaying a screen for the chair or a screen for a non-chair on a display device,
The server may transmit a signal based on the third authority information to each terminal, and the selection unit of each terminal may cause the display device to display a chairperson or non-chairperson screen on the basis of the signal. Good.
[0016]
In this case, the multipoint conferencing system identifies whether each terminal of each group is operated by the chair of the group or a general participant other than the chair, and as a result, the terminal operated by the chair of the group is displayed. A screen for the chairperson is automatically displayed on the device, and a screen for the non-chairperson (general participant) is automatically displayed on the display device of the terminal operated by the general participant. Therefore, any terminal of each group can be used as a chair terminal or a general participant terminal, so that the convenience of the system is improved.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION
An embodiment according to the present invention will be described below with reference to the accompanying drawings.
[0018]
1 to 5 show one embodiment of a multipoint conference system according to the present invention. This conference system 2 is for holding a conference, for example, by connecting remote places or in one conference room. As shown in FIG. 1, a plurality of terminals 3a to 3e arranged at different points, and these terminals 3a 3e and a conference management server 6 connected via a communication line 4. Each of the terminals 3a to 3e includes an audio input unit, an audio output unit, a video input unit, a display unit (also serving as a video output unit), a control unit for controlling these, and an operation unit for inputting a user command. In the computer system provided, software for multipoint conference is installed in the control unit. The server 6 automatically switches communication between the server 6 and the plurality of terminals 3a to 3e based on a proceeding schedule registered in the server 6 in advance, as described later. In the present embodiment, data transmitted and received between the terminals 3a to 3e and the server 6 include image data, audio data, presentation data, progress data, change instruction data (change request data), authority data, and the like. These data will be described later. As the communication line 4, a wired transmission line or a wireless transmission line, such as the Internet, a wired or wireless LAN, a digital telephone line (for example, ISDN), an analog telephone line as an ADSL system, or a combination thereof is used. Note that the present invention is not limited to the number of terminals. In the following description, a terminal used by the chair of the conference (hereinafter, referred to as a chair terminal) is referred to as a terminal 3a.
[0019]
As shown in FIG. 2, the server 6 includes an authentication unit 10, a conference reservation unit 12, a schedule management unit 14, a conference control unit 16, a schedule change control unit 18, a multipoint control unit 20, and a database 22.
[0020]
The authentication unit 10 authenticates the user based on the user ID and the password registered in the user data recorded in the database 22 when the terminals 3 a to 3 e connect to the conference management server 6. Things. This authentication is performed when a conference is reserved and when the user participates in a conference. The user data is data in which an ID and a password of a person who is qualified to use the multipoint conference system 2 are registered, and are registered in advance of a conference reservation or a conference.
[0021]
FIG. 6 shows a flowchart when the terminal connects to the server 6. First, the index n is set to 0 in step S601, and the terminal accesses the server 6 in step S602. FIG. 7 shows a user login screen when making a conference reservation. In step S603, the authentication unit 10 of the server 6 compares the input user ID and password data with the user data to determine whether the user is a specific user. If the terminal can be authenticated, the terminal completes the connection to the server 6 (step S604). If authentication is not received in step S603, the flow proceeds to step S605. If the index n does not exceed the predetermined value N in step S605, the process proceeds to step S606, where the index n is incremented, and the process returns to step S602. If the index n exceeds N in step S605, that is, if the state in which authentication cannot be performed continues for a certain number of times, the server 6 notifies the terminal of connection rejection (step S607).
[0022]
Returning to FIG. 2, the conference reservation unit 12 activates a conference reservation screen and records the proceedings schedule in the database 22 based on information input via the screen. As shown in FIG. 8, as the proceedings progress schedule, the authority information of each terminal at each time during the conference (first authority information indicating whether the terminal is the chair terminal or the general participant terminal, and the presenter terminal (each terminal) 3a to 3e, a terminal having “operation right” of a presentation screen (presentation screen) displayed on the display unit) or second authority information indicating whether the terminal is a non-presenter terminal), and a plurality of information during a meeting as described later. When a meeting is held in each group after being divided into groups, the group ID and the like are included.
[0023]
FIG. 9 is a flowchart when making a conference reservation via a terminal. As described above, the terminal accesses the server 6 (at this time, the user login screen shown in FIG. 7 is displayed on the display unit of the terminal) (step S901). (Step S902), the conference reservation unit 12 displays the conference reservation screen shown in FIG. 10 on the display unit of the terminal (Step S903). In step S904, necessary items are input. The input items include the theme of the meeting, the date and time of the meeting, the agenda (start / end time, presentation time, presenter terminal, presentation theme), participant terminal information (host name (for example, IP address), participant name / affiliation, If the conference is divided into a plurality of groups during the conference and the conference is held, division information (division / merging time, terminals belonging to each group, chair terminal in each group) and the like are included. . In step S905, when the user confirms that there is no deficiency in the input items (for example, when clicking “input completed” on the conference reservation screen in FIG. 10), the screen is switched to a confirmation screen for input items (not shown). The user clicks a “confirm” button on the confirmation screen.) In step S906, the conference reservation unit 12 records the input items in the database 22 and also stores some of the above-described data (for example, Authority information) is saved as the proceeding schedule, and the flow ends. It should be noted that the terminals used for making a conference reservation do not need to be the terminals 3a to 3e for making a conference.
[0024]
Returning to FIG. 2, the schedule management unit 14 outputs data of the proceeding schedule to the meeting control unit 16 as appropriate (for example, at fixed time intervals), and receives a command from the schedule change control unit 18 to change the proceeding schedule. It is for rewriting. The conference control unit 16 controls the multipoint control unit 20 based on the data from the schedule management unit 14, and starts when a predetermined time comes before the scheduled conference start time recorded in the proceeding schedule. ing. The server 6 has a built-in clock and a timer (not shown) for providing time information to the schedule management unit 14 and the conference control unit 16. The schedule change control unit 18 controls the schedule management unit 14 to rewrite the proceeding schedule recorded in the database 22 when a schedule is changed by a request from the chair terminal 3a. The multipoint control unit 20 controls communication between the server 6 and the plurality of terminals 3a to 3e based on an instruction from the conference control unit 16. The multipoint control unit 20 will be described later in detail.
[0025]
FIG. 3 shows the transmission unit 30 of each of the terminals 3a to 3e. The transmitting unit 30 includes, for example, a video input unit 32 such as a camera that captures the face of a participant, an A / D converter 34 that converts an analog signal input from the input unit 32 into a digital signal, and a converter 34. An encoding circuit 36 performs encoding such as compression on the output image data, and a packetizing circuit 38 that attaches a header to the encoded image data and packetizes the encoded image data. The transmitting unit 30 also includes an audio input unit 40 such as a microphone, an A / D converter 42 that converts an analog signal input from the input unit 40 into a digital signal, and an audio data output from the converter 42. An encoding circuit 44 for performing encoding and a packetizing circuit 46 for attaching a header to the encoded audio data and packetizing the data are provided. Further, when presentation software (for example, PowerPoint (trade name)) is running on its own terminal, the transmitting unit 30 further converts the image format of the software data (hereinafter referred to as presentation data) (for example, from the PPT format to the moving image format). An image format conversion circuit 48 for conversion, an encoding circuit 50 for encoding the presentation data whose image format has been converted by the conversion circuit 48, and a packet for attaching a header to the encoded presentation data and packetizing the data. And a conversion circuit 52. As the image format conversion circuit 48, for example, a custom LSI is used. The transmission unit 30 further includes a display unit 54 that displays a graphical user interface (GUI) screen including operation icons and the like together with the presentation screen. By clicking an icon via the operation unit 56 such as a keyboard and a mouse, the display unit 54 outputs change instruction data at the chair terminal 3a or change request data at the other terminals 3b to 3e. In the case where a PDA (personal data assistant) is used as a component of the terminal, the operation unit 56 corresponds to a touch panel.
[0026]
The transmission unit 30 further includes a data processing unit 58 that processes the change instruction data (change request data), and a packetizing circuit 60 that attaches a header to the processed change instruction data (change request data) and packetizes the data. . The transmission unit 30 also includes a multiplexing circuit 62 for multiplexing packetized image data, audio data, presentation data, and change instruction data (change request data) to create multiplexed data. The data processing unit 58 also has a function of controlling the operation of the image format conversion circuit 48 based on the received authority data, as described later.
[0027]
The change request data is created when a non-presenter requests an operation right for a presentation screen while a presentation is being made via another terminal. The change instruction data is used when the non-presenter requests the right to operate the presentation screen, when the chair grants the right to operate, when the chair forcibly ends the presentation during the presentation, and when the It is created when performing. After these data are processed by the data processing unit 58, they are packetized by the packetizing circuit 60, and subsequently multiplexed with other data and transmitted to the server 6. As will be described later, on the server side, change request data or change instruction data is separated from the multiplexed data and output to the schedule change control unit 18.
[0028]
FIG. 4 shows a detailed configuration of the multipoint control unit 20. In the following description, it is assumed that the presenter terminal is the terminal 3c. The multipoint control unit 20 includes separation circuits 70a to 70e for separating image data, audio data, presentation data, and change instruction data (change request data) from the multiplexed data transmitted from each of the terminals 3a to 3e. Decoding circuits 72a to 72e for decoding the audio data separated by the circuits 70a to 70e, respectively. The multipoint control unit 20 further includes a multiplexing unit 74 that multiplexes the image data separated by the separation circuits 70a to 70e to create multiplexed image data. The multiplexing unit 74 includes a plurality of multiplexing circuits to divide and merge conferences. The change instruction data separated by the separation circuit 70a from the multiplexed data transmitted from the chair terminal 3a is output to the schedule change control unit 18. When receiving the change instruction data, the schedule change control unit 18 controls the schedule management unit 14 to rewrite the proceeding schedule in the database 22. When change request data is transmitted from a certain general participant terminal, for example, the terminal 3d, the change request data separated by the separation circuit 70d from the multiplexed data transmitted from the terminal 3d is output to the schedule change control unit 18. . When receiving the change request data, the schedule change control unit 18 transfers the data to the conference control unit 16. Then, the conference control unit 16 controls the multipoint control unit 20 to transmit the change request data to the chair terminal 3a.
[0029]
The multipoint control unit 20 further includes: a mixing unit 76 for synthesizing the audio data decoded by the decoding circuits 72a to 72e; an encoding circuit 78 for encoding the audio data synthesized by the mixing unit 76; A packetization circuit 79 for attaching a header to the synthesized speech data encoded in 78 and packetizing the data. The mixing unit 76 includes a plurality of mixing circuits for dividing and merging conferences. The multipoint control unit 20 additionally includes a packetization unit 80 that attaches a header to each of the progress data, authority data, and / or change instruction data (change request data) output from the conference control unit 16, and multiplexes the data. Multiplexed image data output from the converting unit 74, synthesized voice data output from the packetizing circuit 79, presentation data output from the separating circuit 70c of the presenter 3c, progress data output from the packetizing unit 80, authority A multiplexing / distributing unit 81 for multiplexing data and change request data (change instruction data) to create multiplexed data and transmitting the multiplexed data to the terminals 3a to 3e is provided. The multiplexing / distributing unit 81 includes a plurality of multiplexing / distributing circuits for dividing / merging conferences.
[0030]
Although illustration is omitted, the multipoint control unit 20 recognizes the communication capabilities of the terminals 3a to 3e, determines parameters for data transfer (for example, a data compression method, a receivable transfer speed, and the like), and A multipoint controller for transmitting and receiving data for communication control between the server 3 and the server 3a is provided. The control data is multiplexed with image data and the like and transmitted to the terminals 3a to 3e. It has become.
[0031]
It is preferable that the mixing unit 76 synthesizes the audio data so that each audio data transmitted from each of the terminals 3a to 3e is not transmitted to the same terminal and an echo is not generated. For example, regarding the terminal 3d, the multiplexing and distribution unit 81 multiplexes the synthesized data of the audio data of the terminals 3a to 3c and 3e, excluding the audio data transmitted from the terminal 3d, with the multiplexed image data and the like. Send.
[0032]
FIG. 5 shows the receiving unit 82 of each of the terminals 3a to 3e. The receiving unit 82 includes a separation circuit 84 that separates the multiplexed data transmitted from the server 6 into multiplexed image data, synthesized audio data, presentation data, progress data, and authority data based on the header. As will be described later, when another terminal requests a right to operate the presentation screen, the multiplexed data transmitted to the chair terminal 3a includes change request data. When the chairperson permits the change of the operation right of the presentation screen or forcibly ends the presentation, the multiplexed data transmitted to the presentation terminal includes the change instruction data.
[0033]
The receiving unit 82 also separates the multiplexed image data separated by the separation circuit 84 into a plurality of image data based on a header, and decodes the plurality of image data separated by the separation circuit 86. A decoding unit 88 having a plurality of decoding circuits, and a VRAM 90 into which each image data decoded by the decoding unit 88 is written are provided. Based on each image data written in the VRAM 90, at a predetermined position on the display unit 54, for example, the face of the participant captured by the video input unit 32 of each of the terminals 3a to 3e is displayed. . As described above, the display unit 54 displays all images captured by the terminals 3a to 3e including the own terminal, but the image captured by the own terminal may not be displayed on the display unit 54. Good.
[0034]
The receiving unit 82 further includes a decoding circuit 92 for decoding the synthesized voice data separated by the separation circuit 84, a D / A converter 94 for converting a digital signal output from the decoding circuit 92 into an analog signal, An audio output unit 96 such as a speaker that outputs an analog signal output from the D / A converter 94 is provided. As described above, the voices of all the other participants can be heard through the audio output unit 96 of each of the terminals 3a to 3e, but only the voice of the presenter or the chair may be heard.
[0035]
The receiving unit 82 further includes a decoding circuit 98 for decoding the presentation data separated by the separation circuit 84. The image format of the data decoded by the decoding circuit 98 is converted from, for example, the image format to the PPT format by the image format conversion circuit 48. The presentation data whose image format has been converted by the image format conversion circuit 48 is displayed on a presentation screen at a predetermined position on the display unit 54. In addition, a document camera may be used as the video input unit, and data of materials captured by the camera may be used as presentation data.
[0036]
The progress data indicates the progress of the meeting, which is transmitted from the meeting management server 6 to each of the terminals 3a to 3e based on the proceeding schedule, and the data processing unit 58 outputs the progress data separated by the separation circuit 84. , The presentation theme, the presenter information (for example, the presenter's name and affiliation), the remaining time of the announcement, and the like are displayed at predetermined positions on the display unit 54.
[0037]
The authority data is obtained from the server 6 based on first authority information (chair terminal or general participant terminal) and second authority information (presentation terminal or non-presenter terminal) described in the proceeding schedule. This is transmitted to the terminals 3a to 3e. The data processing unit (selection unit) 58 displays a chairperson GUI screen (FIG. 11) on the display unit 54 based on the authority data separated by the separation circuit 84 if the own terminal is the chair terminal, Is a general participant (non-chairperson) terminal, the display unit 54 has a function of displaying a GUI screen (FIG. 12) for general participants. Referring to FIG. 3 as well, based on the authority data separated by separation circuit 84, data processing section 58 drives image format conversion circuit 48 if the terminal itself is a presenter terminal, and activates the presenter terminal at the presenter terminal. The data of the presentation software, that is, the application data, is transmitted to the server. If the terminal itself is a non-presenter terminal, the image format conversion circuit 48 is not operated (that is, the presentation data is not transmitted to the server 6).
[0038]
The basic operation of the multipoint conference system 2 having such a configuration will be described. When the presentation is performed via the terminal 3c, that is, when the authority data indicating that the terminal 3c is the presentation terminal is transmitted from the conference management server 6 to each of the terminals 3a to 3e, the presenter terminal 3c , Image data, audio data, presentation data, and non-presenter terminals 3a, 3b, 3d, and 3e, where image data and audio data are multiplexed, and each multiplexed data is transmitted to the server 6 via the communication line 4. Is done.
[0039]
In the multipoint control unit 20, the multiplexed data transmitted from each of the terminals 3a to 3e is separated into image data, audio data, and presentation data in the separation circuit 70c based on the header added to each packet. The separation circuits 70a, 70b, 70d, and 70e separate the image data and the audio data based on the header added to each packet. The plurality of image data separated by the respective separation circuits 70 a to 70 e are multiplexed by the multiplexing unit 74, and the multiplexed image data is supplied to the multiplexing distribution unit 81. The plurality of audio data separated by the respective separation circuits 70a to 70e are combined by the mixing unit 76, encoded by the encoding circuit 78, and then packetized by the packetization circuit 79, and then synthesized speech data. Is supplied to the multiplex distribution unit 81. The presentation data separated by the separation circuit 70c corresponding to the presenter terminal 3c is supplied to the multiplexing / distributing unit 81. Further, the progress data and the authority data are supplied from the conference control unit 16 to the multiplexing / distributing unit 81 via the packetizing unit 80. The multiplexing / distributing unit 81 multiplexes the multiplexed image data, the synthesized audio data, the presentation data, the progress data, and the authority data, and transmits the multiplexed data to the terminals 3a to 3e.
[0040]
In each of the terminals 3a to 3e, when receiving the multiplexed data, the separation circuit 84 separates the multiplexed image data into multiplexed image data, synthesized audio data, presentation data, progress data, and authority data. The multiplexed image data is further separated by the separation circuit 86 into a plurality of image data. The data processing unit 58 displays the GUI screen of FIG. 11 on the chair terminal and the GUI screen of FIG. 12 on the general participant terminal on the display unit 54 based on the authority data. The synthesized voice data is output as voice via the voice output unit 96. Each of the image data, the presentation data, and the progress data is displayed at a predetermined position on the display unit 54. However, the data processing unit 58 of the terminal of the participant other than the presenter (including the chair) causes the transmitted presentation data to be displayed on the display unit 54, but the data processing unit 58 of the presenter terminal 3c transmits the presentation data. The data of the presentation software running on the terminal 3c is directly displayed on the display unit 54 without using the received presentation data. The multiplexing / distributing unit 81 of the multipoint control unit 20 may transmit multiplexed data obtained by multiplexing data other than the presentation data to the presenter terminal 3c to the terminal 3c.
[0041]
Here, the GUI screen of FIG. 11 displayed on the display unit 54 of the chair terminal 3a will be described. At the center of the screen is graph data as presentation data, at the top of the screen are presentation themes, presenter information, remaining time as conference progress information, and at the right side of the screen are chairpersons as image data from each terminal (including its own terminal). An image of the face of the general participant, and an icon for the chairman to operate are displayed at the bottom of the screen.
[0042]
The operation icons are used by the chairman to exercise necessary authority for the operation of the conference, thereby enabling a smooth conference progress. "Change operation authority", "division of the conference", "forced termination", etc. are prepared. ing.
[0043]
The “forced termination” is for forcibly terminating the presentation during the presentation. When the chairman clicks “forced termination”, the forced termination information is sent from the chair terminal 3a to the schedule change control unit 18 of the server 6. The change instruction data including the change instruction data is transmitted. The change instruction data is transferred to the conference control unit 16, and the conference control unit 16 transmits the change instruction data to the presenter terminal, and deprives the "operation right". Specifically, when the data processing unit 58 of the presenter terminal receives the change instruction data, the data processing unit 58 stops the operation of the image format conversion circuit 48, whereby the data of the presentation software running on the presenter terminal is transmitted to the server 6. Will not be sent to. However, the application data at the time of the forced termination may be displayed on the display unit 54 of each of the terminals 3a to 3e. Upon receiving the change instruction data, the schedule change control unit 18 controls the schedule management unit 14 to rewrite the proceeding schedule so that the conference is advanced only for the remaining time of the presenter. Thereafter, the schedule management unit 14 outputs the data of the changed proceedings schedule to the conference control unit 16.
[0044]
"Change operation right" is for forcibly switching the operation right of the presentation screen from the presenter terminal to another terminal, and when the chairman clicks "change operation right", the screen showing the candidate of the switching terminal is displayed (Not shown) is displayed on the display unit 54. When the chair selects one of the terminals to which the operation right is given via the operation unit 56, the change instruction data including the operation right change information is transmitted from the chair terminal 3 a to the schedule change control unit 18 of the server 6. The schedule change control unit 18 rewrites the “authority” item (second authority information) of the proceeding schedule so that the operation right of the presentation screen is switched from the presenter terminal to another terminal. After that, the schedule management unit 14 outputs the data of the changed proceedings schedule to the conference control unit 16, and the conference control unit 16 controls the multipoint control unit 20 so that it can be presented via another terminal. . At the end of the presentation, when the chairman inputs the end of the switching on the display screen of the candidate for the switching terminal or the like, the chairman terminal 3a sends the change instruction data including the operation right change information to the schedule change control unit 18 of the server 6. Is sent. The schedule change control unit 18 rewrites the “authority” item (second authority information) of the proceedings progress schedule so that the original presentation terminal can be given the operation right of the presentation screen again. When the operation right of the presentation screen is moved to another terminal, instead of displaying the data of the presentation software started on the other terminal on the display unit 54 of each of the terminals 3a to 3e, the start of the original presentation terminal is started. The multipoint conference system 2 may be designed so that the presentation software being operated can be operated on the other terminal.
[0045]
“Meeting division” is for inputting information for dividing into a plurality of groups during a meeting. When the chairman clicks on "meeting split", a split information input screen (not shown) appears on the display unit 54 of the chairman terminal 3a. When necessary items are input, the division data is transmitted from the chair terminal 3a to the server 6, and the schedule change control unit 18 of the server 6 controls the schedule management unit 14 to rewrite the "group ID" item of the proceeding schedule. The conference control unit 16 controls the multipoint control unit 20 according to this information to divide the conference. The meeting division will be described later in detail.
[0046]
On the display unit 54 of the chair terminal 3a, a screen (not shown) inquiring about whether or not to extend the time appears at the scheduled end time of the presentation or at a predetermined time before it. The chair can extend the time by inputting the extended time via the operation unit 56. When receiving the change instruction data including the extension time information from the chair terminal 3a, the schedule change control unit 18 of the server 6 controls the schedule management unit 14 and rewrites the proceeding schedule so that the conference is advanced by the extension time. Thereafter, the schedule management unit 14 outputs the data of the changed proceedings schedule to the conference control unit 16. If finished on time, the chair will enter a no extension instruction.
[0047]
Further, when a request for operation right of the presentation screen is made from the non-presenter terminal during the conference, a screen (not shown) indicating the request for operation right is displayed on the display unit 54 of the chair terminal 3a. It has become. The chair inputs via the operation unit 56 whether or not the request can be made. In the case of permitting the request, upon receiving the change instruction data including the operation right change information from the chair terminal 3a, the schedule change control unit 18 of the server 6 controls the schedule management unit 14 to change the operation right of the presentation screen to the presenter. The "authority" item (second authority information) in the proceeding schedule is rewritten so that the terminal becomes the terminal of the requester from the terminal. Thereafter, the schedule management unit 14 outputs the data of the changed proceedings schedule to the conference control unit 16, and the conference control unit 16 controls the multipoint control unit 20 so that the requester can make a presentation. If the request is not permitted, a message indicating that the request is not permitted is displayed only on the terminal that has made the request. When the chairman inputs the end of the request on the screen indicating the operation right request or the like at the end of the announcement of the requester, the operation right change information is included in the schedule change control unit 18 of the server 6 from the chair terminal 3a. The change instruction data is transmitted. The schedule change control unit 18 controls the schedule management unit 14 to rewrite the "authority" item (second authority information) of the proceeding schedule so that the original presentation terminal is given the operation right of the presentation screen again. To As described above, when the non-presenter terminal requests the operation right of the presentation screen during the meeting, the chairperson can give permission.
[0048]
Although illustration is omitted, during the division of the conference, at the time of the merger, an inquiry about merger permission is displayed on the display unit 54 of the chair terminal of each group. The chair inputs via the operation unit 56 whether or not the request can be made. When permitting the request, the chair terminal transmits change instruction data including merge permission information to the server 6. When receiving the change instruction data from all the chairs, the schedule change control unit 18 controls the schedule management unit 14 to output the data of the proceeding schedule after the merger to the conference control unit 16. The conference control unit 16 controls the multipoint control unit 20 to merge groups so that data can be transmitted and received among all the terminals 3a to 3e. The meeting merger will be mentioned later.
[0049]
FIG. 12 shows a GUI screen displayed on the display unit 54 of the general participant terminals 3b to 3e. Similar to the chair terminal 3a, the center of the screen is graph data as presentation data, the upper part of the screen is a presentation theme, presenter information, remaining presentation time as meeting progress information, and the right side of the screen is the chair as image data from each terminal. And an image of the face of a general participant is displayed. At the bottom of the screen, icons for general participants to operate are displayed. When the presenter has been given the right to operate the presentation screen to his / her own terminal, the presenter can display the data of the presentation software started on his / her terminal on the presentation screen of each terminal, and will explain based on this presentation screen. The operation icons include a “request for operation right of presentation screen” (described later) for the general participant to request the operation right of the presentation screen.
[0050]
Next, a flow of a conference using the multipoint conference system 2 will be described with reference to a flowchart shown in FIG.
[0051]
In step S1301, each participant (including the chairperson) starts multipoint conference software on its own terminal, and connects the terminal to the conference management server 6 in step S1302. The server 6 confirms whether or not the terminal is registered at the time of the conference reservation, and if the terminal is a registered terminal, in step S1303, the display unit 54 of the terminal displays the content and schedule of the conference to be held this time. The conference initial screen (FIG. 14) is displayed.
[0052]
In step S1304, the conference control unit 16 starts up a predetermined time before the conference start time recorded in the registered proceeding schedule. In step S1305, the conference control unit 16 of the server 6 transmits the authority data to each of the terminals 3a to 3e based on the proceeding schedule. As a result, the display unit 54 of each of the terminals 3a to 3e displays the first authority. A screen corresponding to the information is displayed. Specifically, referring to the subroutine of FIG. 15, in step S1501, the data processing unit 58 of each of the terminals 3a to 3e confirms the host name (for example, IP address) of its own terminal. It is determined whether the own terminal is a chair terminal or a general participant terminal based on the above. If the terminal is a chair terminal, a GUI screen for a chair (FIG. 11), and if a general participant terminal, a GUI screen for a general participant (FIG. ) Is displayed on the display unit 54 (steps S1503 and S1504). At this point, the information of the chairperson and the face of the presenter are displayed on the GUI screen, and voice exchange between terminals is possible, but the presentation theme, presenter, remaining time of presentation, and presentation data are not displayed. .
[0053]
Returning to FIG. 13, at step S1306, at the time when the first presenter, for example, the operator of the terminal 3c makes a presentation, the second authority information of the authority data transmitted from the server 6 to each of the terminals 3a to 3e is: “The presentation terminal is the terminal 3c”. In step S1307, based on the authority data, the data processing unit 58 of the terminal 3c controls the image format conversion circuit 48 to transmit the data of the presentation software running on the terminal 3c to the server 6. The data of the presentation software running on the other terminals 3a, 3b, 3d, 3e is not transmitted to the server 6. Since the multipoint control unit 20 of the server 6 transmits only the data of the presentation software running on the terminal 3c to each of the terminals 3a to 3e, the announcement screen of the display unit 54 of each of the terminals 3a to 3e includes The data of the presentation software is displayed. In addition, the data processing unit 58 of each of the terminals 3 a to 3 e causes the display unit 54 to display the presentation theme, the presenter, and the remaining time of the presentation based on the progress data transmitted from the server 6. In this way, by displaying the presenter and the remaining time on all terminals, not only the chair terminal 3a, the participants can easily grasp the progress of the meeting, and thus the chair can efficiently operate the meeting. effective.
[0054]
If the chairman does not forcibly end the presentation in the middle of the presentation in step S1308, at step S1309, when the scheduled end time of the presentation is reached, a screen appears on the display unit 54 of the chairperson terminal 3a as to whether or not there is a time extension. The chairperson can input an extension time via the operation unit 56 (YES in step S1310, S1311), or can input an instruction for no extension (NO in step S1310). After the presentation, in step S1312, a question and answer session is performed until the next presenter's presentation time comes. In this state, the presentation software started by the presenter terminal may be operated from another terminal as needed. Although not shown in the figure, the time for the question and answer may be extended. In this case, similarly to the case where the presentation time is extended, the schedule change control unit 18 of the server 6 controls the schedule management unit 14 and rewrites the proceedings schedule so that the conference is advanced by the extended time.
[0055]
If the chairperson forcibly ends the presentation in the middle of the presentation in step S1307, the process proceeds to step S1312, and a question and answer session is performed.
[0056]
In step S1313, when there is a next announcement, for example, when the terminal 3d is the next announcement terminal, the process returns to step S1306, and at a predetermined time, the authority data transmitted from the server 6 to each of the terminals 3a to 3e. The second authority information is “the presentation terminal is the terminal 3d”. Based on the authority data, the data processing unit 58 of the terminal 3d controls the image format conversion circuit 48 to transmit the data of the presentation software running on the terminal 3d to the server 6. The data of the presentation software running on the other terminals 3 a to 3 c and 3 e is not transmitted to the server 6. Since the multipoint control unit 20 of the server 6 transmits only the data of the presentation software running on the terminal 3d to each of the terminals 3a to 3e, the presentation screen of the display unit 54 of each of the terminals 3a to 3e includes: The data of the presentation software is displayed. In addition, the data processing unit 58 of each of the terminals 3 a to 3 e causes the display unit 54 to display the presentation theme, the presenter, and the remaining time of the presentation based on the progress data transmitted from the server 6.
[0057]
When the operations of steps S1306 to S1312 are repeated and the announcement of the schedule ends, the process proceeds to step S1314, where the conference is summarized and the conference ends. At the meeting summary time, if necessary, the presenter gives presenter authority to a certain terminal so that the data of the presentation software started by the presenter terminal can be displayed on the display unit 54 of each of the terminals 3a to 3e. You may. Although not shown in the drawing, the time for this summarization may be extended. In this case, similarly to the case where the presentation time is extended, the schedule change control unit 18 of the server 6 controls the schedule management unit 14 and rewrites the proceedings schedule so that the conference is advanced by the extended time.
[0058]
As described above, the “operation right” is automatically switched to the presenter terminal based on the proceeding schedule recorded in the database 22 in advance, so that the burden of the chairman on the proceeding of the meeting can be greatly reduced.
[0059]
Next, a procedure for the general participant terminal to obtain the operation right of the presentation screen will be described with reference to FIG. In step S1601, when a general participant, for example, the operator of the terminal 3d clicks the “request for operation right of presentation screen” icon on the GUI screen of the display unit 54, the change request data is transmitted from the terminal 3d to the server (FIG. 4). In response, the server 6 sends change request data to the chair terminal 3a. In step S1602, a display to the effect of requesting the operation right is displayed on the display unit 54 of the chair terminal 3a. If the chairperson permits the operation right request in step S1603, the process advances to step S1604, and the change instruction data is transmitted from the chairman terminal 3a to the server 6. As a result, the schedule change control unit 18 of the server 6 controls the schedule management unit 14 so that the operation right of the presentation screen changes from the presenter terminal to the terminal 3d of the requester, and the “authority” item ( (The second authority information). Thereafter, the schedule management unit 14 outputs the data of the changed proceedings schedule to the conference control unit 16, and the conference control unit 16 controls the multipoint control unit 20 so that the requester can make a presentation. In step S1605, when the chairman inputs the end of the request when the presentation of the requester ends, the schedule change control unit 18 rewrites the “authority” item (second authority information) of the proceeding schedule, and As a result, the right to operate the presentation screen is given again to the original presentation terminal (step S1606). If the request is not permitted in step S1603, the process proceeds to step S1607, and a message indicating that the request is not permitted is displayed only on the terminal that has made the speech request.
[0060]
By the way, multipoint conferences are held not only outside the company but also outside the company, but there are cases where it is necessary to talk about confidential content between internal participants while keeping them inaudible to external participants during the conference . Therefore, in the multipoint conference system 2 according to the present embodiment, the conference is divided into a plurality of groups in the middle of the conference, and can be merged thereafter.
[0061]
FIG. 17 shows the database 22 by inputting predetermined information on the conference reservation screen of FIG. 10 or on the screen displayed by the chairperson clicking the “meeting division” icon during the conference as described above. The data of the recorded proceedings schedule is shown. When the conference is divided into a plurality of groups, for example, a group 1 including terminals 3a, 3c and 3d and a group 2 including terminals 3b and 3e, a group ID corresponding to each of the terminals 3a to 3e is assigned in advance. Also, for each terminal of each group, the third authority information of the chair terminal (the chair terminal is 3a in the group 1, the chair terminal is 3e in the group 2) or the general participant terminal at each time during the conference division is recorded. Have been. In the example of the figure, the chair terminal of group 1 and the chair terminal in the conference using all the terminals are the same for the terminal 3a, but may be different. Further, the fourth authority information of the presenter terminal or the non-presenter terminal at each time during the conference division is recorded for each terminal of each group.
[0062]
Referring to FIG. 4, multiplexing section 74, mixing section 76, and multiplexing / distributing section 81 of multipoint control section 20 each include a plurality of multiplexing circuits, mixing circuits, and multiplexing / distributing circuits, as described above. Have. Upon receiving the conference division information from the schedule management unit 14, the conference control unit 16 controls the multiplexing unit 74, the mixing unit 76, and the multiplexing and distribution unit 81 as follows. That is, the multiplexing unit 74 multiplexes the image data transmitted from the terminals 3a, 3c, and 3d of the group 1 into the first multiplexed image data by one of the multiplexing circuits, The image data transmitted from the two terminals 3 b and 3 e are multiplexed to form second image multiplexed data and output to the multiplexing / distributing unit 81. The mixing unit 76 is one of the mixing circuits, synthesizes audio data transmitted from the terminals 3a, 3c, and 3d of the group 1 to produce first synthesized audio data. , 3e, and synthesizes them as second synthesized voice data, and outputs the second synthesized voice data to the multiplexing / distributing unit 81. As described above, it is preferable that the echo canceling process be performed by the mixing unit 76. In this case, only the audio data from the terminal that is not the own terminal is transmitted to the terminals 3b and 3e of the group 2 including the two terminals. The multiplexing / distributing unit 81 is one of the multiplexing / distributing circuits, and includes progress data and authority data (including third and fourth authority information) together with the first multiplexed image data and the first synthesized audio data. Is multiplexed and transmitted as first multiplexed data to each of the terminals 3a, 3c, and 3d, and is processed by another multiplexing circuit together with the second image multiplexed data and the second synthesized voice data together with the progress data and the like. Authority data (including third and fourth authority information) is multiplexed and output to each terminal 3b, 3e as second multiplexed data. The data processing unit 58 of each terminal in each group displays the GUI screen of FIG. 11 on the chair terminal of the group and the GUI screen of FIG. 12 on the general participant terminal on the display unit 54 based on the authority data. .
[0063]
The flow of the progress of the conference division / merger using the multipoint conference system 2 will be described with reference to the flowchart shown in FIG. If the chair inputs predetermined information on the conference reservation screen in FIG. 10 or on the screen displayed by clicking the “meeting split” icon during the meeting, if the scheduled division time comes in step S1801, the process proceeds to step S1802. The conference control unit 16 of the server 6 transmits the authority data to each terminal based on the division information of the proceeding schedule, and as a result, the display unit 54 of each of the terminals 3a to 3e displays the authority data according to the third authority information. Screen is displayed. Specifically, the data processing unit 58 of each of the terminals 3a to 3e checks the host name (for example, IP address) of its own terminal, and based on the fourth authority information of the authority data, determines whether the own terminal is the chair terminal or the general participation. It is determined whether or not the terminal is a chair terminal. If it is the chair terminal of the group (terminal 3a of group 1 and terminal 3e of group 2), the GUI screen for the chair (FIG. 11) and the general participant terminals (terminals 3c and 3d of group 1 and In the case of the terminal 3b) of the group 2, the GUI screen (FIG. 12) for general participants is displayed on the display unit 54. At the same time, in step S1803, the conference control unit 16 of the server 6 sets the multiplexing unit 74, the mixing unit 76, and the multiplexing unit of the multipoint control unit 20 based on the division information of the proceeding schedule output from the schedule management unit 14. Terminal 3a to terminal 3a, 3c, 3d and terminal 3b, so that image data and audio data of each group can be transmitted and received between terminals of the same group. Divide into group 2 of 3e.
[0064]
In step S1804, a conference is held in each group. The transmission and reception of data between the terminal and the server 6 during the conference in each group is the same as the conference in which all the terminals 3a to 3e participate. That is, in the group 1, for example, at the time when the operator of the terminal 3d announces, the fourth authority information of the authority data transmitted from the server 6 to each of the terminals 3a, 3c, 3d is “presentation terminal is terminal 3d”. It becomes. Based on the authority data, the data processing unit 58 of the terminal 3d controls the image format conversion circuit 48 to transmit the data of the presentation software running on the terminal 3d to the server 6. The data of the presentation software running on the other terminals 3a and 3c is not transmitted to the server 6. The multipoint control unit 20 of the server 6 transmits the data of the presentation software running on the terminal 3d to the terminals 3a, 3c, and 3d. The screen displays the data of the presentation software. Further, the data processing unit 58 of each of the terminals 3a, 3c, 3d causes the display unit 54 to display the presentation theme, the presenter, and the remaining time of presentation based on the progress data transmitted from the server 6. Of course, there may be a case where presentation is not performed in each group even if the group is divided. In this case, for example, presentation data is not transmitted and received between the terminals 3a, 3c, and 3d of the group 1.
[0065]
When the scheduled merger time comes in step S1805, in step S1806, an inquiry about merger permission is displayed on the display unit 54 of the chair terminals 3a and 3e of each of the groups 1 and 2. In step S1807, the chairperson of each group operates the operation unit 56 and responds as to whether or not the merger is permitted according to the situation. When the server 6 receives the change instruction data indicating the merge permission from all the chair terminals 3a and 3e, the process proceeds to step S1808, where the conference control unit 16 sets the multiplexing unit 74, the mixing unit 76, and the multiplexing unit of the multipoint control unit 20. Control unit 81, and merge the groups 1 and 2 so that all terminals 3a to 3e can transmit and receive image data, audio data, and the like. At the same time, in step S1809, a screen indicating the post-merger schedule as shown in FIG. 19 is displayed on the display unit 54 of each of the terminals 3a to 3e, and the flow ends. In the example of FIG. 19, the resumption time of the conference after the merger, the remaining presentation time, the presenter, the presentation theme, the already announced information, and the like are displayed.
[0066]
In step S1807, if any of groups 1 and 2 (if there are three or more groups, one of the groups), for example, group 2 does not permit the merge, the merge of the groups is not performed, and in step S1810, the server 6 Receives the disapproval signal from the chair 3e of the group 2, transmits a signal to the chair terminal 3a of the group 1, and the display unit 54 of the chair terminal 3a displays "there is a group not permitted to be merged". You. In this way, the merger of groups is not performed automatically, but is performed after obtaining the agreement of all groups in advance, so that information that is inconvenient for members of one group will not leak to other groups. As a result, it is possible to hold various conferences not only inside the company but also outside the company.
[0067]
As described above, the meeting is automatically divided based on the proceeding schedule recorded in the database 22 in advance, so that the burden of the chairman on the progress of the meeting can be greatly reduced.
[0068]
In addition, referring to the screen of the chair terminal of FIG. 11, “meeting merger” is prepared as the operation icon. This is for asking the chairperson of another group whether the merger is possible when the meeting is divided into at least three or more. Specifically, when the chair of a certain group clicks on “Meeting merger”, a screen (not shown) displaying other group candidates that can be merged appears on the display unit 54 of the terminal of this chair. Has become. When the chair selects a desired group from among them, the server 6 receives a signal from the terminal of the chair who wants to merge, and transmits a signal asking whether or not to merge the group to the terminals of the chair of the selected group. If there is a permission signal from the chair terminal of the selected group, the conference control unit 16 controls the multipoint control unit 20 to merge the two groups.
[0069]
The above description relates to one embodiment of the present invention, and the present invention is not limited to this, and can be variously modified. For example, in the above embodiment, the presentation data is transmitted to the server 6 only from the terminal having the “operation right”, but the presentation data may be transmitted to the server 6 from all the terminals 3a to 3e. Good. In this case, the multipoint control unit 20 is provided with a circuit for selecting presentation data by the conference control unit 16 based on the second authority information. The selected presentation data is multiplexed with the multiplexed image data and the like and transmitted to each of the terminals 3a to 3e.
[0070]
【The invention's effect】
According to the present invention, switching of communication between a server and a plurality of terminals, for example, switching of operation right of a presentation screen is automatically performed according to a pre-registered proceeding schedule, so that the burden on the chair is greatly reduced. The meeting can proceed smoothly while reducing.
[Brief description of the drawings]
FIG. 1 is a configuration diagram showing an embodiment of a multipoint conference system according to the present invention.
FIG. 2 is a block diagram showing a configuration of a conference management server of FIG. 1;
FIG. 3 is a block diagram showing a configuration of a transmission unit of each terminal in FIG. 2;
FIG. 4 is a block diagram illustrating a configuration of a multipoint control unit in FIG. 2;
FIG. 5 is a block diagram showing a configuration of a receiving unit of each terminal in FIG. 2;
FIG. 6 is a flowchart showing a procedure for connecting to the conference management server.
FIG. 7 is a diagram showing an example of a user login screen when making a conference reservation.
FIG. 8 is a diagram showing an example of data of a proceeding schedule recorded in a database of a conference management server.
FIG. 9 is a flowchart showing a procedure for making a conference reservation.
FIG. 10 is a diagram showing an example of a conference reservation screen.
FIG. 11 is a view showing an example of a GUI screen displayed on the display unit of the chair terminal.
FIG. 12 is a diagram showing an example of a GUI screen displayed on a display unit of a general participant terminal.
FIG. 13 is a flowchart showing the flow of a conference progress using the multipoint conference system of FIG. 1;
FIG. 14 is a diagram showing an example of a conference initial screen.
FIG. 15 is a flowchart showing a subroutine of step S1305 in FIG. 13;
FIG. 16 is a flowchart showing a procedure for a general participant terminal to obtain an operation right on a presentation screen.
FIG. 17 is a view showing an example of data of a meeting progress schedule representing meeting division information recorded in a database of the meeting management server.
FIG. 18 is a flowchart showing the flow of a conference division / merger process using the multipoint conference system of FIG. 1;
FIG. 19 is a diagram showing an example of a screen displayed on each terminal after the merger.
[Explanation of symbols]
2: Multipoint conference system
3a to 3e: terminal
4: Communication line
6: Meeting management server
22: Database
58: Data processing unit (selection unit)

Claims (5)

In a multipoint conference system including a plurality of terminals arranged at different points and a server connected to the plurality of terminals via a communication line,
The server has a database storing the proceedings schedule, and a multipoint control unit for controlling communication between the plurality of terminals,
A multipoint conference system, wherein the server controls the multipoint control unit based on the proceedings schedule stored in the database, and thereby switches communication between the server and a plurality of terminals. The proceedings progress schedule includes first authority information for distinguishing between the chair terminal and the non-chair terminal,
Each terminal includes a selection unit for selectively displaying a screen for the chair or a screen for a non-chair on a display device,
The server transmits a signal based on the first authority information to each terminal, and the selection unit of each terminal causes the display device to display a screen for a chairperson or a screen for a non-chairperson based on the signal. The multipoint conference system according to claim 1, wherein The proceeding schedule includes second authority information for distinguishing the presenter terminal from the non-presenter terminal,
3. The server according to claim 1, wherein the server controls the multipoint control unit based on the second authority information, thereby giving authority to a specific terminal among the plurality of terminals as a presenter terminal. Multipoint conference system. The proceeding schedule includes division information for dividing a plurality of devices into a plurality of groups,
The multipoint conference system according to claim 1, wherein the server controls the multipoint control unit based on the division information, thereby dividing the plurality of terminals into a plurality of groups. The division information includes third authority information for distinguishing a chair terminal and a non-chair terminal in each group,
Each terminal includes a selection unit for selectively displaying a screen for the chair or a screen for a non-chair on a display device,
The server transmits a signal based on the third authority information to each terminal, and the selection unit of each terminal causes the display device to display a screen for a chairperson or a screen for a non-chairperson based on the signal. 5. The multipoint conference system according to claim 4, wherein:

Images