JP2021056840A - Program, communication method, communication terminal and communication system - Google Patents

Abstract

To provide a program, a communication method, a communication terminal and a communication system, capable of performing a screen layout according to a type of ice break to perform the ice break in a video conference system.SOLUTION: A program allows a computer to function as: acquisition means for acquiring from an administrative system ice break information relating to an ice break to be executed in a video conference achieved by transmitting and receiving an audio signal between a communication terminal and other communication terminals via a network; transmission means for transmitting a change request for requesting a change in a layout of a screen by layout information according to the ice break included in the ice break information from the administrative system to the other communication terminals by transmitting a start request for starting the ice break specified in the ice break information at the other communication terminals to the administrative system; and display control means for causing a display device to display a progress state of the ice break to be executed at the other communication terminals.SELECTED DRAWING: Figure 5

Description

The present invention relates to programs, communication methods, communication terminals and communication systems.

Conventionally, in companies, educational institutions, government agencies, etc., a voice signal is input to a microphone to transmit the voice signal to another information processing device, and a voice signal and a camera received from the other information processing device. A video conferencing system that reproduces video through speakers and a display is used. "Webinar", which holds seminars in video conferencing systems, is generally recognized, and workshops are one of the genres of seminars. In the workshop, the organizer gives lectures on a specific theme to multiple participants, but the participants are divided into multiple groups, and each group discusses or moves hands to experience. There is a part where such participants are the main players.

In general, participants in a group often meet for the first time, and in order to ease tensions between participants, the organizer does not have to suddenly engage in group discussions and activities, but icebreakers first. Make a break. Here, an ice breaker shows a method for relieving the tension when people who meet for the first time meet each other, soothes the gathered people, creates an atmosphere that facilitates communication, and actively aims to achieve the purpose gathered there. Show the technology to encourage people to get involved. As for the types of ice breaks, two people from the group introduce themselves in pairs, and the other participants in the group are introduced to the other participants in pairs, and others. A quiz in which the organizer gives a quiz, each participant in the group thinks about the answer, and the first participant answers the first letter, the second letter is the second letter, and so on. There are various types such as games. In a meeting where participants actually meet, not in a video conferencing system, in the introduction of others, the seats are moved so that it is easy to talk with the paired participants, and in the quiz game, the characters answered by each participant. Allocate a place to answer each participant so that the answers are in the correct order, and consider the arrangement of the participants. When performing such an ice break in a video conferencing system, it is necessary to change the screen layout to an appropriate one according to the type of ice break.

As a video conferencing system that changes the screen layout, in order to hold a video conferencing without changing the screen layout frequently according to the communication status, the number of video data to be displayed in the screen area is determined by the communication status, and the number is determined. A configuration is disclosed in which when receiving moving image data, the still image data of the moving image data is stored, and when the number of received moving image data is less than the number of the screen area, the still image data is displayed in the screen area. (For example, Patent Document 1).

However, the technique described in Patent Document 1 has a problem that when an ice break is performed in a video conferencing system, the screen layout cannot be changed to an appropriate screen layout according to the type of ice break.

The present invention has been made in view of the above, and provides a program, a communication method, a communication terminal, and a communication system capable of performing an ice break by laying out a screen according to the type of ice break in a video conferencing system. The purpose is to provide.

In order to solve the above-mentioned problems and achieve the object, the present invention causes a computer to be executed in a video conferencing realized by transmitting and receiving a voice signal to and from a communication terminal and another communication terminal via a network. The icebreaker is obtained by transmitting to the management system an acquisition means for acquiring icebreaker information regarding the break from the management system and a start request for starting the icebreaker specified by the icebreaker information on the other communication terminal. A transmission means for transmitting a change request for changing the screen layout from the management system to the other communication terminal based on the layout information corresponding to the ice break included in the break information, and execution by the other communication terminal. It is characterized in that it functions as a display control means for displaying the progress of an ice break on a display device.

According to the present invention, in a video conferencing system, it is possible to perform an ice break by performing a screen layout according to the type of ice break.

FIG. 1 is a schematic configuration diagram of a communication system according to an embodiment. FIG. 2 is a diagram showing an example of the hardware configuration of the communication terminal according to the embodiment. FIG. 3 is a diagram showing an example of the hardware configuration of the management system and the program providing system according to the embodiment. FIG. 4 is a diagram showing an example of the software configuration of the communication terminal according to the embodiment. FIG. 5 is a diagram showing an example of the configuration of the functional block of the communication system according to the embodiment. FIG. 6 is a diagram showing an example of the authentication management table. FIG. 7 is a diagram showing an example of a terminal management table. FIG. 8 is a diagram showing an example of the conference management table. FIG. 9 is a diagram showing an example of a session management table. FIG. 10 is a diagram showing an example of an ice break information management table. FIG. 11 is a diagram showing an example of an ice break progress management table. FIG. 12 is a diagram showing an example of an icebreaker answer management table. FIG. 13 is a diagram showing a session established for transmitting and receiving content data and various management information in the communication system according to the embodiment. FIG. 14 is a sequence diagram showing an example of a process in the preparatory stage including an authentication process for the communication terminal to start a call. FIG. 15 is a diagram showing an example of a destination list screen. FIG. 16 is a sequence diagram showing an example of a plenary session start process in the communication system according to the embodiment. FIG. 17 is a diagram showing an example of a start request dialog box. FIG. 18 is a diagram showing an example of a conference screen (host) of a plenary session. FIG. 19 is a sequence diagram showing an example of a group conference start process in the communication system according to the embodiment. FIG. 20 is a diagram showing an example of a group selection screen. FIG. 21 is a diagram showing an example of a group meeting status screen immediately after the start of the group meeting. FIG. 22 is a diagram showing an example of a group meeting start request dialog box. FIG. 23 is a diagram showing an example of a conference screen (host) of a general conference when a specific participant enters a group conference. FIG. 24 is a diagram showing an example of a group meeting status screen when a specific participant enters the group meeting. FIG. 25 is a sequence diagram showing an example of an operation of starting an ice break in the communication system according to the embodiment. FIG. 26 is a diagram showing an example of an ice break selection screen. FIG. 27 is a diagram showing an example of a group meeting status screen during an ice break. FIG. 28 is a diagram showing an example of an ice break screen of a quiz game. FIG. 29 is a sequence diagram showing an example of an ice break operation of a quiz game in the communication system according to the embodiment. FIG. 30 is a diagram showing an example of an ice break screen in which self-answers are displayed. FIG. 31 is a diagram showing an example of an ice break screen in which all the answers are displayed. FIG. 32 is a diagram showing an example of a group meeting status screen when the group a finishes the ice break. FIG. 33 is a sequence diagram showing an example of an ice break operation of self-introduction in the communication system according to the embodiment. FIG. 34 is a diagram showing an example of a conference screen (guest) of a group conference. FIG. 35 is a diagram showing an example of an ice break screen for introducing others. FIG. 36 is a diagram showing an example of a software configuration when using the Web application of the communication terminal according to the embodiment.

Hereinafter, embodiments of the program, communication method, communication terminal, and communication system according to the present invention will be described in detail with reference to the drawings. Further, the present invention is not limited by the following embodiments, and the components in the following embodiments include those easily conceived by those skilled in the art, substantially the same, and so-called equivalent ranges. Is included. Furthermore, various omissions, substitutions, changes and combinations of components can be made without departing from the gist of the following embodiments.

In addition, computer software refers to programs related to computer operations and other information used for processing by computers that are equivalent to programs (hereinafter, computer software is referred to as software). Application software is a general term for software used to perform a specific task in the classification of software. On the other hand, an operating system (OS) is software that controls a computer and enables application software or the like to use computer resources. The operating system performs basic computer management and control, such as input / output control, hardware management such as memory and hard disk, and process management. The application software operates by utilizing the functions provided by the operating system. A program is a command to a computer that is combined so that one result can be obtained. In addition, a program-like thing cannot be called a program because it is not a direct command to the computer, but it has properties similar to a program in that it regulates the processing of the computer. For example, a data structure (a logical structure of data represented by an interrelationship between data elements) corresponds to a program.

(Overall configuration of communication system)
FIG. 1 is a schematic configuration diagram of a communication system according to an embodiment. The outline of the overall configuration of the communication system 1 according to the present embodiment will be described with reference to FIG.

As shown in FIG. 1, the communication system 1 includes a plurality of communication terminals 10aa, 10ab, 10ba, 10bb, 10ca, 10cab, 10da, 10db, displays 120aa, 120bb, 120ca, 120db for each communication terminal, and a management system. The 50 and the program providing system 90 are included, and are constructed so as to be able to communicate with each other via the communication network 2.

Note that, in FIG. 1, communication terminals 10aa, 10ab, 10ba, 10bb, 10ca, 10cab, 10da, and 10db are shown, but when any communication terminal is shown or generically referred to, simply "communication terminal 10" is shown. ". Further, the plurality of communication terminals 10 included in the communication system 1 shown in FIG. 1 are shown as an example, and may have different numbers.

Further, in FIG. 1, displays 120aa, 120bb, 120ca, and 120db are shown, but when any display is shown or generically referred to, it is simply referred to as "display 120". Further, the plurality of displays 120 included in the communication system 1 shown in FIG. 1 are shown as an example, and may be different in number depending on the number of communication terminals 10.

Further, the communication terminal 10 may be any of a dedicated device to which a display (display 120 described above) is connected, a desktop PC (Personal Computer), a notebook PC, a smartphone, a tablet terminal, and the like. However, in the following, the communication terminal 10 will be described as a notebook PC.

The communication terminal 10 is a terminal that transmits and receives various information to and from other devices. The communication terminal 10 establishes a session with another communication terminal 10, and in the established session, makes a call by transmitting and receiving content data including voice data and image data (video data). As a result, in the communication system 1, video conferencing between a plurality of communication terminals 10 is realized. The video conference may be simply referred to as a "conference".

The management system 50 is a computer that centrally manages the communication terminal 10. The management system 50 realizes a video conference by a call or the like between the communication terminals 10 by establishing a session between the communication terminals 10. When the management system 50 receives a session start request from a predetermined communication terminal 10, the management system 50 establishes a session between the communication terminal 10 (start request terminal) that transmitted the start request and the destination terminal, and starts a video conference. Let me. Therefore, the management system 50 relays the content data between the plurality of communication terminals 10 by the established session. Although the management system 50 establishes a session between a plurality of communication terminals 10, the content data may actually be relayed by another relay device. In the present embodiment, for the sake of brevity, the establishment of the session and the relay of the content data will be described as being performed by the management system 50.

The program providing system 90 is provided with an auxiliary storage device (HDD (Hard Disk Drive) or the like) in which a terminal program for realizing various functions or various means is stored in the communication terminal 10, and the communication terminal 10 is used for the terminal. A computer that provides a program (communication application A, etc., which will be described later). Further, the program providing system 90 also stores a program for realizing various functions or various means in the management system 50 or the like in the auxiliary storage device, and can transmit the corresponding program to the management system 50 or the like.

As shown in FIG. 1, the communication network 2 is constructed including, for example, LAN (Local Area Network) 2a to 2d, dedicated lines 2ab, 2cd, and the Internet 2i. The communication network 2 is not limited to the configuration shown in FIG. 1, and may include other network devices, and there may be a place where wireless communication is performed as well as wired communication. ..

The LANs 2a to 2d and the leased lines 2ab and 2cd include routers 70a to 70d, 70ab, and 70cd, respectively. The routers 70a to 70d, 70ab, and 70cd are network devices that select the optimum route for communication data. In addition, when referring to any router among routers 70a to 70d, 70ab, and 70cd, or generically, it is simply referred to as "router 70".

The communication terminals 10 (10aa, 10ab, ...) And the router 70a are communicably connected by LAN2a. Further, the communication terminals 10 (10ba, 10bb, ...) And the router 70b are communicably connected by LAN2b. Further, the LAN 2a, the LAN 2b, and the router 70ab are communicably connected by a dedicated line 2ab, and are constructed in the area A.

On the other hand, the communication terminal 10 (10ca, 10cc, ...) And the router 70c are communicably connected by LAN2c. Further, the communication terminal 10 (10da, 10db, ...) And the router 70d are communicably connected by LAN2d. Further, the LAN 2c, the LAN 2d, and the router 70 cd are connected by a dedicated line 2 cd so as to be communicable, and are constructed in the area B.

The networks of region A and region B are communicably connected via the Internet 2i by routers 70ab and 70cd, respectively.

Further, the management system 50 and the program providing system 90 are communicably connected to each communication terminal 10 via the Internet 2i. The management system 50 and the program providing system 90 may be installed in the area A or the area B, or may be installed in an area other than these.

Further, in FIG. 1, the four sets of numbers shown in the vicinity of each communication terminal 10, the management system 50, each router 70, and the program providing system 90 are simple IP (Internet Protocol) addresses in general IPv4. It is shown in. For example, the IP address of the communication terminal 10aa is assumed to be "1.2.1.3". Although IPv6 may be used instead of IPv4, IPv4 will be used for the sake of simplicity.

The configuration of the communication system 1 shown in FIG. 1 is an example, and is not limited to this configuration. That is, the number of each device and system shown in FIG. 1 is not limited to the number shown in FIG. Further, in FIG. 1, the network configurations of the two regions A and B are shown, but the networks may be within the same region, and the configuration is such that three or more regions are connected by a network. May be good.

(Hardware configuration of communication terminal)
FIG. 2 is a diagram showing an example of the hardware configuration of the communication terminal according to the embodiment. The details of the hardware configuration of the communication terminal 10 will be described with reference to FIG.

As shown in FIG. 2, the communication terminal 10 according to the present embodiment includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an auxiliary storage device 105, and the like. It includes a media drive 107 and an input device 108.

The CPU 101 is an arithmetic unit that controls the operation of the entire communication terminal 10. The ROM 102 is a non-volatile storage device that stores a program for the communication terminal 10 (communication application A or the like described later). The RAM 103 is a volatile storage device used as a work area of the CPU 101.

The auxiliary storage device 105 is a non-volatile storage device such as an HDD or SSD (Solid State Drive) that stores various data such as image data, audio data, and moving image data. The media drive 107 is a device that controls reading and writing of data to the media 106 such as a flash memory according to the control of the CPU 101. The media 106 is a storage device that can be attached to and detached from the communication terminal 10. The media 106 is not limited to the flash memory as long as it is a non-volatile memory that reads and writes data under the control of the CPU 101, and an EEPROM (Electrically Erasable and Programmable ROM) or the like may be used.

The input device 108 is a device for inputting various information such as a mouse or a keyboard, and a button such as a power button.

Further, the communication terminal 10 includes a network I / F 111, an image sensor I / F 113, an audio input / output I / F 116, a display I / F 119, a camera 112, a microphone 114, a speaker 115, and a display 120. It has.

The network I / F 111 is an interface for communicating data using the communication network 2. The network I / F111 is, for example, a NIC (Network Interface Card) compliant with TCP (Transmission Protocol) / IP (Internet Protocol).

The image sensor I / F 113 is an interface for transmitting image data to and from the camera 112 that captures a subject and obtains image data under the control of the CPU 101. The camera 112 includes a lens and a solid-state image sensor that converts light into electric charges to digitize an image (video) of a subject. The camera 112 is connected to the image sensor I / F 113 by a cable 112c. As the solid-state image sensor, CMOS (Complementary Metal Oxide Semiconductor), CCD (Charge Coupled Device), or the like is used.

The audio input / output I / F 116 is an interface that processes audio signal (audio data) input / output between the microphone 114 for inputting audio and the speaker 115 for outputting audio under the control of the CPU 101. The microphone 114 and the speaker 115 are connected to the audio input / output I / F 116 by the cable 114c and the cable 115c, respectively.

The display I / F 119 is an interface for transmitting image data to the display 120 under the control of the CPU 101. The display 120 is a display device composed of a liquid crystal, an organic EL (Electro-Luminescence), or the like that displays an image of a subject, an operation icon, or the like. The display 120 is connected to the display I / F 119 by a cable 120c. The cable 120c may be a cable for analog RGB (VGA) signals, a cable for component video, HDMI® (High-Definition Multimedia Interface) or DVI (Digital Visual Interface) signals. It may be a cable for.

The above-mentioned CPU 101, ROM 102, RAM 103, auxiliary storage device 105, media drive 107, input device 108, network I / F 111, image pickup element I / F 113, audio input / output I / F 116 and display I / F 119 are an address bus and a data bus. Etc., which are connected to each other so as to be able to communicate with each other.

The hardware configuration of the communication terminal 10 shown in FIG. 2 is an example, and may include components other than the components shown in FIG. Further, at least one of the camera 112, the microphone 114, and the speaker 115 may be used as an external device separate from the communication terminal 10.

(Hardware configuration of management system, etc.)
FIG. 3 is a diagram showing an example of the hardware configuration of the management system and the program providing system according to the embodiment. The details of the hardware configuration of the management system 50 and the program providing system 90 will be described with reference to FIG.

First, the hardware configuration of the management system 50 will be described with reference to FIG. As shown in FIG. 3, the management system 50 includes a CPU 201, a ROM 202, a RAM 203, an auxiliary storage device 205, a media drive 207, a display 208, a network I / F 209, a keyboard 211, a mouse 212, and the like. It includes a DVD (Digital Versaille Disc) drive 214.

The CPU 201 is an arithmetic unit that controls the operation of the entire management system 50. The ROM 202 is a non-volatile storage device that stores a program for the management system 50. The RAM 203 is a volatile storage device used as a work area of the CPU 201.

The auxiliary storage device 205 is a storage device such as an HDD or SSD that stores various data such as the authentication management DB 5001, the terminal management DB 5002, the session management DB 5003, the conference management DB 5004, and the ice break management DB 5005, which will be described later. The media drive 207 is a device that controls reading and writing of data to a recording medium 206 such as a flash memory according to the control of the CPU 201.

The display 208 is a display device composed of a liquid crystal, an organic EL, or the like that displays various information such as a cursor, a menu, a window, characters, or an image. The network I / F 209 is an interface for communicating data using the communication network 2. The network I / F209 is, for example, a TCP / IP compliant NIC or the like.

The keyboard 211 is an input device for selecting characters, numbers, various instructions, moving a cursor, and the like. The mouse 212 is an input device for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like.

The DVD drive 214 is a device that controls reading and writing of data to a DVD 213 such as a DVD-ROM or a DVD-R (DVD Recordable) as an example of a removable storage medium. As another example of the above-mentioned removable recording medium, it may be configured to be recorded and provided on a computer-readable recording medium such as a CD-R (Compact Disk Recordable) or a Blu-ray disc.

The CPU 201, ROM 202, RAM 203, auxiliary storage device 205, media drive 207, display 208, network I / F 209, keyboard 211, mouse 212, and DVD drive 214 can communicate with each other by bus lines 210 such as an address bus and a data bus. It is connected to the.

The hardware configuration of the management system 50 shown in FIG. 3 is an example, and it is not necessary to include all the components shown in FIG. 3, or it may include other components.

Further, the above-mentioned program for the management system 50 may be recorded and distributed on a computer-readable recording medium such as a recording medium 206 or a DVD 213 by a file in an installable format or an executable format. ..

Further, since the program providing system 90 has the same hardware configuration as the management system 50 described above, the description thereof will be omitted. However, the ROM 202 records a program for the program providing system 90 for controlling the program providing system 90. In this case as well, the program for the program providing system 90 is a file in an installable format or an executable format, and can be recorded and distributed on a computer-readable recording medium such as a recording medium 206 or a DVD 213. Good.

(Software configuration of communication terminal)
FIG. 4 is a diagram showing an example of the software configuration of the communication terminal according to the embodiment. The details of the software configuration of the communication terminal 10 will be described with reference to FIG.

The communication application A is installed as a client application on the communication terminal 10. Here, the application means application software. As shown in FIG. 4, the OS (Operating System) 1020 and the communication application A operate on the work area 1010 of the RAM 103 of the communication terminal 10.

OS1020 is basic software that provides basic functions and manages the entire communication terminal 10. The communication application A is an application that operates according to the control of the OS 1020 and communicates (calls) with another communication terminal 10.

Examples of the communication protocol of the communication application A include SIP (Session Initiation Protocol), H.323, IRC (Internet Relay Chat), and Jingle.

(Communication system functional block configuration)
FIG. 5 is a diagram showing an example of the configuration of the functional block of the communication system according to the embodiment. The configuration of the functional block of the communication system 1 according to the present embodiment will be described with reference to FIG.

<Structure of functional blocks of communication terminals>
As shown in FIG. 5, the communication terminal 10 stores / reads the communication unit 11, the operation input receiving unit 12, the imaging unit 13, the display control unit 14, the voice input unit 15, the voice output unit 16. It has a unit 17, a storage unit 18, and an authentication request unit 19.

The communication unit 11 is a functional unit that transmits / receives various data to / from another communication terminal 10 or each system via the communication network 2. The communication unit 11 is realized by the execution of the communication application A, which is software by the CPU 101 shown in FIG. 2, and the network I / F 111.

The communication unit 11 indicates the state of each communication terminal 10 as a candidate for a destination terminal from the management system 50 before the communication terminal 10 establishes a session with another communication terminal 10 and starts a video conference by a telephone call. Start receiving each status information. Here, the candidate of the destination terminal is another communication that is a destination candidate used by the user (participant) who is the partner of the video conference that the communication terminal 10 can specify as the partner of the video conference, that is, the partner of the session. The terminal 10. That is, the communication terminal 10 cannot establish a session with a communication terminal used by a user who is not preset as a user (participant) who participates in the video conference, and cannot hold a video conference.

Further, the status information includes the operating status (online or offline status) of each communication terminal 10 and the detailed status (hereinafter referred to as communication status) such as whether the call is in progress or the standby status is online. ) And. Further, the status information is set not only for the operating status and communication status of each communication terminal 10, but also for the cable to be disconnected from the communication terminal 10, sound can be output but no image can be output, or sound is not output. It may indicate various states such as (MUTE), but in the following, a case of indicating an operating state and a communication state will be described as an example.

When the communication terminal 10 operates as a start request terminal, the communication unit 11 transmits a conference start request to the management system 50. Here, the conference start request is information for requesting the start of a session used for a video conference. In addition, the communication unit 11 manages the conference start request, the terminal ID of the start request terminal that is the source of the conference start request, and the user ID of the participant who uses (logs in) the communication terminal 10. Send to. The terminal ID is information for identifying the communication terminal 10, and may be stored in the communication terminal 10 in advance or may be directly input to the communication terminal 10 by the user to determine the terminal ID. The user ID is information that uniquely identifies the user, and may be freely set by the user, an e-mail address used by the user, or the like.

The operation input receiving unit 12 is a functional unit that receives various inputs by the user. The operation input receiving unit 12 is realized by the input device 108 shown in FIG.

For example, when the user turns on the power button as the input device 108 shown in FIG. 2 of the operation input receiving unit 12, the power of the communication terminal 10 is turned on. Further, when the user turns off the power from the on state, the communication unit 11 transmits the state information indicating that the power of the communication terminal 10 is turned off to the management system 50, and then the power supply of the communication terminal 10 is turned off. Is completely turned off. As a result, the management system 50 can grasp that the communication terminal 10 has been turned off from the power on.

The image capturing unit 13 is a functional unit that captures an image of a subject and acquires image data obtained by capturing the image. The image pickup unit 13 is realized by the execution of the communication application A by the CPU 101 shown in FIG. 2 and the camera 112 and the image pickup element I / F 113.

The display control unit 14 is a functional unit that controls the display of image data or the like on the display 120. The display control unit 14 is realized by executing the communication application A by the CPU 101 shown in FIG.

The display control unit 14 is, for example, a candidate for a destination terminal received by the communication unit 11 before the communication terminal 10 as the request source of the video conference starts a video conference talk with the communication terminal 10 as a desired destination. The display 120 displays a destination list including the names of candidates for each destination terminal and the user IDs of participants who use the destination terminals, reflecting the status information of.

The voice input unit 15 is a functional unit that inputs the voice signal after the voice of the participant (speaker) is converted into a voice signal by the microphone 114. The voice input unit 15 is realized by the execution of the communication application A by the CPU 101 shown in FIG. 2 and the voice input / output I / F 116.

The audio output unit 16 is a functional unit that outputs an audio signal to the speaker 115 and outputs audio from the speaker 115. The voice output unit 16 is realized by the execution of the communication application A by the CPU 101 shown in FIG. 2 and the voice input / output I / F 116.

The storage / reading unit 17 is a functional unit that stores various data in the storage unit 18 and reads various data stored in the storage unit 18. In the storage unit 18, for example, the content data received when making a call with the destination terminal is overwritten and stored each time it is received. Of these, the image is displayed on the display 120 by the image data before being overwritten, and the sound is output from the speaker 115 by the sound data before being overwritten. The storage / reading unit 17 is realized by executing the communication application A by the CPU 101 shown in FIG.

The authentication request unit 19 logs in to the management system 50 from the communication unit 11 via the communication network 2 when the power of the communication terminal 10 is turned on or when the operation input reception unit 12 accepts the authentication request operation. It is a functional unit that transmits the authentication request information indicating that the authentication is requested and the current IP address of the communication terminal 10. The authentication request unit 19 is realized by executing the communication application A by the CPU 101 shown in FIG.

At least one of the display control unit 14 and the authentication request unit 19 may be realized by a hardware circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).

Further, each functional unit of the communication terminal 10 shown in FIG. 5 conceptually shows a function, and is not limited to such a configuration. For example, a plurality of functional units illustrated as independent functional units in the communication terminal 10 shown in FIG. 5 may be configured as one functional unit. On the other hand, the function of one functional unit of the communication terminal 10 shown in FIG. 5 may be divided into a plurality of functions and configured as a plurality of functional units.

<Structure of functional blocks of management system>
As shown in FIG. 5, the management system 50 includes a communication unit 51, an authentication unit 52, a state management unit 53, an extraction unit 54, a terminal state acquisition unit 55, a session control unit 56, and a storage / reading unit. It has 57, a storage unit 58, a conference management unit 59, and an ice break management unit 60 (acquisition means, acquisition unit). The storage unit 58 is realized by the auxiliary storage device 205 shown in FIG. 3, and as shown in FIG. 5, the storage unit 58 includes an authentication management DB 5001, a terminal management DB 5002, a session management DB 5003, a conference management DB 5004, and an ice break management DB 5005. I remember. Hereinafter, each table managed in each DB stored in the storage unit 58 will be described.

<< Authentication management table >>
FIG. 6 is a diagram showing an example of the authentication management table.

The storage unit 58 stores the authentication management DB 5001 including the authentication management table shown in FIG. In the authentication management table, a password is associated and managed with respect to a user ID that identifies a user (participant) who uses the communication terminal 10 that authenticates login. Here, the password is information used for authenticating login. For example, in the authentication management table shown in FIG. 6, it is shown that the password associated with the user ID "A_10aa" is "aaaa".

The user ID is identification information such as characters, symbols, numbers or various signs used to uniquely identify the user who uses the communication terminal 10, and is, for example, an e-mail address used by the user. You may.

<< Terminal management table >>
FIG. 7 is a diagram showing an example of a terminal management table.

The storage unit 58 stores the terminal management DB 5002 including the terminal management table shown in FIG. 7. In the terminal management table, for each terminal ID of each communication terminal 10, the terminal name, the user ID of the user who logged in to each communication terminal 10, the operating state of each communication terminal 10, the communication state with other communication terminals 10, and each. The IP address of the communication terminal 10 is associated and managed.

Here, the operating state includes an online state in which the power is turned on and communication is possible or in progress, and an offline state in which communication is not possible such as when the power is not turned on. Further, as the communication state, for example, there are "Calling", "Ringing", "Accepted", "Busy", "None" and the like. "Calling" is a state in which another communication terminal 10 is being called, that is, a state in which a conference start request for establishing a session used for video conferencing is transmitted to the other communication terminal 10 and a response is awaited. Shown. “Ringing” indicates a state in which the conference start request is called from the other communication terminal 10, that is, a conference start request is received from the other communication terminal 10, and the response to the received conference start request is not completed. "Accepted" permits the state in which the permission response to the conference start request from the other communication terminal 10 is completed, but the session establishment is not completed, and the conference start request sent by the own terminal. Indicates that the reception of the response of is completed, but the session establishment is not completed. “Busy” indicates a state in which a session with another communication terminal 10 has been established and a call is being made by communicating content data in a video conference. “None” indicates a state in which the user is not communicating with another communication terminal 10 and is in standby mode.

For example, in the terminal management table shown in FIG. 7, the communication terminal 10ad having the terminal ID "10ad" has the terminal name "Japan Tokyo Office AD terminal" and the user ID of the logged-in user is "C_10ad". The operating state is "online", the communication state is "Ring" indicating a state of being called from another communication terminal 10, and the IP address is shown to be "1.2.1.6".

<< Meeting management table >>
FIG. 8 is a diagram showing an example of the conference management table.

The storage unit 58 stores the conference management DB 5004 including the conference management table shown in FIG. In the conference management table, for each conference ID that identifies the video conference registered in advance in the management system 50, the original conference ID that identifies the original conference when the video conference is a group conference, and the conference name of the video conference. , The user ID of the participant who is currently participating in the video conference (denoted as "participant"), and the user ID of the participant who has the authority to participate in the video conference (denoted as "participation authority owner"). Is associated and managed. The group conference refers to a video conference held in each group by dividing the participants into a plurality of groups in order to perform group work in a certain video conference (original conference). In addition, the original meeting before being divided into this group meeting may be referred to as a "plenary session".

For example, in the conference management table shown in FIG. 8, a conference having a conference ID of "Conf1-1" has a former conference ID of "Conf1" indicating the original conference, a conference name of "Group A", and is currently participating. It is shown that the user IDs of the participants are "A_10aa" and "B_10ac", and the user IDs of the participants who have the authority to participate in the conference are "A_10aa", "B_10ac", "C_10ad" and "D_10ae". ing. In this case, it can be understood that the conference identified by the conference ID "Conf1-1" is a group conference separated from the conference (original conference) indicated by the former conference ID "Conf1".

The subject who participates in the conference can be regarded as a user (participant) who uses the communication terminal 10, and can be regarded as the communication terminal 10 used by the user. That is, it may be expressed as "a user (participant) participates in the conference" or "the communication terminal 10 participates in the conference".

<< Session Management Table >>
FIG. 9 is a diagram showing an example of a session management table.

The storage unit 58 stores the session management DB 5003 including the session management table shown in FIG. In the session management table, for each session ID for identifying the session in which content data is communicated between the communication terminals 10, the terminal ID of the session start request terminal and the conference start request for establishing the session are used as the other party. The terminal ID of the designated destination terminal is associated and managed.

For example, in the session management table shown in FIG. 9, the sessions identified by the session ID "se1" include a start request terminal (communication terminal 10aa) having a terminal ID of "10aa" and a destination terminal (communication terminal 10aa) having a terminal ID of "10db". It shows that it has been established with the communication terminal 10db).

<< Management table for icebreakers >>
FIG. 10 is a diagram showing an example of an ice break information management table. FIG. 11 is a diagram showing an example of an ice break progress management table. FIG. 12 is a diagram showing an example of an icebreaker answer management table.

The storage unit 58 stores the ice break management DB 5005 including the ice break information management table, the ice break progress management table, and the ice break answer management table shown in FIG.

In the icebreaker information management table, for each icebreaker ID for identifying the type of icebreaker, the name of the icebreaker, which is the name of the icebreaker, and the content of the icebreaker are explained. The explanation content and the screen layout transition, which is information that defines the screen transition for advancing the operation of the ice break, are managed in association with each other. The explanation content and screen layout transition associated with the ice break ID have a path indicating a storage location on the storage unit 58 in which the data is stored, instead of managing the data body in the ice break information management table. It may be managed.

For example, in the icebreaker information management table shown in FIG. 10, the icebreaker identified by the icebreaker ID "Conent1" has the icebreaker name "quiz game", the explanation content is "Data1", and the screen layout transition is changed. It is shown to be "Layout 1-1, Layout 1-2".

In the icebreak progress management table, for each conference ID that identifies the video conference, the icebreak ID of the icebreak that is being carried out at the conference identified by the conference ID, the status indicating the progress of the icebreak, and the relevant The screen layout, which is information indicating the layout of the screen currently displayed on the guest communication terminal 10 in the ice break, is associated and managed. The screen layout associated with the conference ID is such that instead of managing the data body in the ice break progress management table, a path indicating a storage location on the storage unit 58 in which the data is stored is managed. May be.

For example, in the icebreak progress management table shown in FIG. 11, the conference ID "Conf1-1" is associated with the icebreak ID "Conent1", the status "Doing", and the screen layout "Layout1-1". Is shown.

In the ice break answer management table, the conference ID of the conference (here, the group conference) in which the user identified by the user ID participates and the answer which is the answer content of the user are associated with each user ID. Be managed.

For example, in the icebreaker answer management table shown in FIG. 12, it is shown that the user ID "B_10ac" is associated with the conference ID "Conf1-1" and the answer "ma".

The information managed in each table shown in FIGS. 6 to 12 is information in a table format, but the information is not limited to this, and if each managed information can be associated, it is not in a table format. It may be managed in the form of.

Returning to FIG. 5, the description of the functional block of the management system 50 returns.

The communication unit 51 is a functional unit that transmits and receives various data to and from the communication terminal 10 or each system via the communication network 2. The communication unit 51 is realized by executing a program by the CPU 201 shown in FIG. 3 and by using the network I / F 209.

The authentication unit 52 uses the user ID and password included in the authentication request information received via the communication unit 51 as a search key, searches the authentication management table (see FIG. 6) of the storage unit 58, and searches the authentication management table. It is a functional unit that authenticates a user by determining whether the same user ID and password are managed. The authentication unit 52 is realized by executing the program by the CPU 201 shown in FIG.

The state management unit 53 is a functional unit that manages the operating state and communication state of the terminal management table shown in FIG. 7. In order to manage the operating state of the communication terminal 10 that has requested login authentication, the state management unit 53 displays the terminal ID of the communication terminal 10 and the user of the participant who is logged in to the communication terminal 10 in the terminal management table. The ID, the operating state of the communication terminal 10, and the IP address of the communication terminal 10 are associated and stored and managed.

When the state management unit 53 changes from the off state to the on state by the operation of the input device 108 by the user of the communication terminal 10, the state management unit 53 of the terminal management table is based on the information sent from the communication terminal 10 to turn on the power. Update the operating status from offline to online. Further, the state management unit 53 manages the terminal based on the information that the power sent from the communication terminal 10 is turned off when the input device 108 is operated by the user of the communication terminal 10 to change from the on state to the off state. Update the operating status of the table from online to offline.

The state management unit 53 is realized by executing a program by the CPU 201 shown in FIG.

The extraction unit 54 searches the conference management table shown in FIG. 8 using the user ID of the participant who is logged in to the target terminal to be processed, such as the communication terminal 10 that has requested login authentication, as a search key, and sets the target terminal. It is a functional unit that reads out the user ID of a participant who uses a candidate of a destination terminal (communication terminal 10 for talking in the same conference) that can make a call, that is, can establish a session. The extraction unit 54 is realized by executing the program by the CPU 201 shown in FIG.

The terminal state acquisition unit 55 is a function unit that searches the terminal management table shown in FIG. 7 using the terminal ID as a search key and reads out the operating state and the communication state for each terminal ID. As a result, the terminal state acquisition unit 55 can acquire the operating state and the communication state of the candidate of the destination terminal capable of making a call with the communication terminal 10 that has requested the login authentication. The terminal state acquisition unit 55 is realized by executing a program by the CPU 201 shown in FIG.

The session control unit 56 is a functional unit that stores and manages the generated session ID, the terminal ID of the start request terminal, and the terminal ID of the destination terminal in association with the session management table shown in FIG. The session control unit 56 controls for establishing a session between the communication terminals 10. The session control unit 56 is realized by executing a program by the CPU 201 shown in FIG.

The storage / reading unit 57 is a functional unit that stores information in various tables in the storage unit 58 and reads information in various tables stored in the storage unit 58. The storage / reading unit 57 is realized by executing a program by the CPU 201 shown in FIG.

The conference management unit 59 manages the start processing or the end processing of the general conference and the group conference triggered by the start operation or the end operation of the general conference or the group conference by the conference administrator (hereinafter sometimes referred to as “host”). It is a functional part to do. Participants other than the administrator (host) in the plenary session may be referred to as "guests".

The conference management unit 59 updates the participant information in the conference management table shown in FIG. 8 according to the entry and exit of the participants participating in the plenary session and the group conference. Here, the participant information specifically indicates the user ID of the participant who actually participates in each conference, that is, the user ID registered in the "participant" of the conference management table. To do. The conference management unit 59 is realized by executing a program by the CPU 201 shown in FIG.

The ice break management unit 60 is a functional unit that manages the operation of the ice break in the video conference. The icebreaker management unit 60 refers to the icebreaker information management table shown in FIG. 10 in order to manage the operation of the icebreaker in the video conference, and according to the progress of the icebreaker, the icebreaker progress management table shown in FIG. And the contents of the icebreaker answer management table shown in FIG. 12 are updated. The ice break management unit 60 is realized by executing a program by the CPU 201 shown in FIG.

At least one of the authentication unit 52, the state management unit 53, the extraction unit 54, the terminal state acquisition unit 55, the session control unit 56, the conference management unit 59, and the ice break management unit 60 is hardware such as an ASIC or FPGA. It may be realized by a circuit.

Further, each functional unit of the management system 50 shown in FIG. 5 conceptually shows a function, and is not limited to such a configuration. For example, a plurality of functional units illustrated as independent functional units in the management system 50 shown in FIG. 5 may be configured as one functional unit. On the other hand, the function of one functional unit of the management system 50 shown in FIG. 5 may be divided into a plurality of functions and configured as a plurality of functional units.

(Status of transmission / reception of content data and various management information)
FIG. 13 is a diagram showing a session established for transmitting and receiving content data and various management information in the communication system according to the embodiment. A session established for transmitting and receiving content data and various management information in the communication system 1 will be described with reference to FIG.

In the example shown in FIG. 13, in the communication system 1, there is a management information session sei for transmitting and receiving various management information between the start request terminal, the destination terminal A, and the destination terminal B via the management system 50. It shows the established state. In this case, a content data session seed for transmitting and receiving image data and audio data is further established between the start request terminal, the destination terminal A, and the destination terminal B via the management system 50. That is, the content data session sed is a session directly used in the video conference. Note that the concept of this session is just an example, and for example, in an image data session, it may be divided according to resolution.

(Transmission / reception processing of each management information in the preparatory stage before the communication terminal starts a call)
FIG. 14 is a sequence diagram showing an example of a process in the preparatory stage including an authentication process for the communication terminal to start a call. FIG. 15 is a diagram showing an example of a destination list screen. With reference to FIGS. 14 and 15, the transmission / reception processing of each information in the preparatory stage before the communication terminal 10aa starts a call will be described. Note that FIG. 14 shows a process in which various management information is transmitted / received by the management information session sei. Further, it is assumed that the group of the conference including the communication terminal 10aa which is the start request terminal is registered in the conference management table together with the user ID of the user who has the authority to participate in the conference by using the conference ID as a key.

<Step S21>
First, when the user of the communication terminal 10aa presses the power button which is the input device 108 shown in FIG. 2, the operation input receiving unit 12 of the communication terminal 10aa accepts the power on and turns on the power of the communication terminal 10aa. ..

<Step S22>
Then, the authentication request unit 19 of the communication terminal 10aa receives the authentication request information indicating the login authentication request from the communication unit 11 to the management system 50 via the communication network 2 when the power of the communication terminal 10aa is turned on. The IP address of the communication terminal 10aa is transmitted. The authentication request information includes a terminal ID for identifying the communication terminal 10aa, which is the own terminal as the start request terminal, a user ID of a user logged in to the communication terminal 10aa, and a password. The terminal ID, user ID, and password are data read from the storage unit 18 by the storage / reading unit 17 of the communication terminal 10aa and sent to the communication unit 11. Further, when the authentication request information is transmitted from the communication terminal 10aa to the management system 50, the management system 50 on the receiving side can grasp the IP address of the communication terminal 10aa on the transmitting side.

<Step S23>
Next, the authentication unit 52 of the management system 50 searches the authentication management table (see FIG. 6) using the user ID and password included in the authentication request information received via the communication unit 51 as search keys, and authenticates. User authentication is performed by determining whether the same user ID and password are managed in the management table.

<Step S24-1>
When the authentication unit 52 determines that the request is for authentication of login from the communication terminal 10aa used by a user having a legitimate usage authority, the state management unit 53 of the management system 50 uses a terminal management table (FIG. 7). (See), the user ID and the IP address of the communication terminal 10aa are associated and stored for each record indicated by the terminal ID and the terminal name of the communication terminal 10aa. As a result, the terminal ID "10aa" of the communication terminal 10aa is managed in association with the user ID "A_10aa" and the IP address "1.2.1.3" in the terminal management table. Hereinafter, the user (participant) having the user ID "A_10aa" may be referred to as "user A_10aa" or "participant A_10aa".

<Step S24-2>
Subsequently, the state management unit 53 sets the operating state "online" and the communication state "None" of the communication terminal 10aa, and sets the operating state in the terminal management table and the record indicated by the terminal ID and the terminal name of the communication terminal 10aa. And memorize the communication status in association with each other. As a result, in the terminal management table, the operating state "online" and the communication state "None" are managed in association with the terminal ID "10aa" of the communication terminal 10aa.

<Step S25>
Then, the communication unit 51 of the management system 50 transmits the authentication result information indicating the result of the terminal authentication obtained by the authentication unit 52 to the start request terminal (communication) via the communication network 2. It is transmitted to the terminal 10aa). In the present embodiment, the case where the communication terminal 10aa is user-authenticated by the authentication unit 52 as a terminal used by a user having a proper usage authority will be continuously described below.

<Step S26>
When the communication terminal 10aa receives the authentication result information indicating the result of user authentication indicating that the terminal is used by a user having a legitimate usage authority, the communication unit 11 sends the management system 50 to the management system 50 via the communication network 2. , Sends the destination list request information indicating that the destination list is requested. As a result, the communication unit 51 of the management system 50 receives the destination list request information.

<Step S27>
Next, the extraction unit 54 of the management system 50 searches the conference management table (see FIG. 8) using the user ID "A_10aa" of the user who uses the start request terminal (communication terminal 10aa) as a search key, and the user A_10aa searches for the conference management table (see FIG. 8). The user ID (participation authority owner) of a user who can make a call, that is, belongs to the same conference (group of conference ID "Conf1") as user A_10aa is extracted. Further, the extraction unit 54 searches the terminal management table using the extracted user ID as a search key, and extracts the terminal ID and the terminal name corresponding to this user ID, that is, the terminal ID and the terminal name of the candidate of the destination terminal.

<Step S28>
Next, the communication unit 51 of the management system 50 transmits the destination list information including the user ID, the terminal ID, and the terminal name of the candidate of the destination terminal extracted by the extraction unit 54 to the start request terminal (communication terminal 10aa). ..

<Step S29>
As a result, in the start request terminal (communication terminal 10aa), the communication unit 11 receives the destination list information, and the storage / reading unit 17 stores the destination list information in the storage unit 18.

As described above, in the present embodiment, the management system 50 centrally manages the destination list information of all the communication terminals 10 instead of managing the destination list information in each communication terminal 10. As a result, even if a new communication terminal 10 is included in the communication system 1 or a communication terminal 10 that is already included is excluded, the management system 50 collectively handles each communication. It is possible to save the trouble of changing the destination list information on the terminal 10 side.

<Step S30>
Further, the terminal state acquisition unit 55 of the management system 50 may use the terminal IDs (“10ac”, “10ad”, “10ae”, “10ba”, “10bb”, “10bc”) of the destination terminals extracted by the extraction unit 54. , "10da") as a search key to search the terminal management table. Then, the terminal state acquisition unit 55 acquires the operating state and communication state of each candidate of the destination terminal by reading the corresponding operating state and communication state for each terminal ID of the candidate of the destination terminal.

<Step S31>
Next, the communication unit 51 obtains the terminal status information including the terminal ID which is the search key used in step S30, the user ID of the corresponding destination terminal candidate, and the status information including the operating status and the communication status. Send to the start request terminal.

Specifically, the communication unit 51 sets the terminal ID "10ac" as a search key, the user ID "B_10ac" of the destination terminal candidate (communication terminal 10ac), the operating state "online", and the communication state "None". The terminal status information including the including status information is transmitted to the start request terminal (communication terminal 10aa). When the operating status is "offline", the status information does not include the communication status. Further, the communication unit 51 is a terminal including a terminal ID "10ac", a user ID "B_10ac" of a candidate for a destination terminal (communication terminal 10ac), and state information including an operating state "online" and a communication state "None". The terminal status information for all the candidates for the destination terminal, such as the status information, is transmitted to the start request terminal (communication terminal 10aa).

<Step S32>
Next, the storage / reading unit 17 of the start request terminal (communication terminal 10aa) sequentially stores the terminal state information received from the management system 50 in the storage unit 18. Therefore, the start request terminal (communication terminal 10aa) can acquire the current operating state and communication state of each of the destination terminal candidates who can make a call by receiving the terminal status information of the destination terminal candidate. it can.

<Step S33>
Next, the display control unit 14 of the start request terminal (communication terminal 10aa) is in the operating state of the destination terminal candidate based on the destination list information stored in the storage unit 18 and the terminal status information of the destination terminal candidate. And create a destination list that reflects the communication status. Then, the display control unit 14 displays the destination list on the display 120 of the communication terminal 10aa at a predetermined timing. An example of the displayed destination list is shown in FIG.

In the example of the destination list screen shown in FIG. 15, the destination list displayed on the display 120 includes the user ID 1100-1 of the candidate terminal, the terminal ID 1105-2 of the candidate terminal, and the terminal name 1100-3. Includes icons 1100-4a to 1100-4c that reflect state information. The icons include an offline icon 1100-4a indicating that a call cannot be made offline, a callable icon 1100-4b indicating that a call can be made online, and an in-call icon 1100-4c indicating that a call is being made online. There is. In the example of the destination list screen shown in FIG. 15, each communication terminal 10 having a terminal ID of "10ab", "10ac", "10db", and "10ad" is illustrated as a candidate for the destination terminal. ..

When the operating state of the destination terminal candidate is "online" and the communication state is "None", the display control unit 14 assigns the call enable icon 1100-4b to the destination terminal candidate. Further, when the operating state of the destination terminal candidate is "online" and the communication state is other than "None", the display control unit 14 sets the busy icon 1100-4c to the destination terminal candidate. assign. Then, when the operating state of the destination terminal candidate is "offline", the display control unit 14 assigns the offline icon 1100-4a to the destination terminal candidate.

In the other communication terminal 10, when the user turns on the power button of the input device 108 shown in FIG. 2, the operation input receiving unit 12 of the communication terminal 10 accepts the on operation as in step S21. , The same process as the process of steps S22 to S33 described above is performed.

(Start processing of plenary session)
FIG. 16 is a sequence diagram showing an example of a plenary session start process in the communication system according to the embodiment. FIG. 17 is a diagram showing an example of a start request dialog box. FIG. 18 is a diagram showing an example of a conference screen (host) of a plenary session. The start processing of the plenary session in the communication system 1 according to the present embodiment will be described with reference to FIGS. 16 to 18.

In FIG. 16, an example in which the communication terminal 10da whose user authentication is performed by the authentication process shown in FIG. 14 transmits a conference start request, that is, an example in which a user who uses the communication terminal 10da is used as a host will be described. Further, the communication terminal 10 used by the host may be referred to as a "host terminal", and another participant of the plenary session managed by the host, that is, the communication terminal 10 used by the guest may be referred to as a "guest terminal". The host communication terminal 10da has an operating state of "online" and a communication state of "None" among the destination terminal candidates based on the terminal state information of the destination terminal candidates received in step S31 of FIG. It is possible to make a call with at least one communication terminal 10 out of a certain communication terminal 10. Hereinafter, a case where the communication terminal 10ac as the destination terminal (guest terminal) receives the conference start request transmitted by the host terminal (communication terminal 10da) will be described. In the state before the process shown in FIG. 16 is started, it is assumed that the destination list screen (see, for example, FIG. 15) is displayed on the display 120 of the communication terminal 10da as the host terminal. Then, the host of the host terminal can select a desired call partner (destination terminal) from the destination list.

<Step S41>
First, the user of the communication terminal 10da selects and operates the destination terminal (communication terminal 10ac) as the destination for requesting the start of the conference via the input device 108, and performs the operation of starting the conference. In this case, the communication terminal 10da that requested the start of the conference is assumed to be the host terminal, and the user of the communication terminal 10da is the host.

<Step S42>
When an operation for requesting the start of a conference is performed on the host terminal (communication terminal 10da), the communication unit 11 of the host terminal receives the conference start request indicating the request to start the conference, the host user ID "H_10da", and the destination terminal. The user ID "B_10ac" of the participant and the IP address of the host terminal are transmitted to the management system 50. As a result, when the communication unit 51 receives the conference start request, the management system 50 grasps the IP address "1.3.2.3" of the host terminal that is the source.

<Step S43>
Then, the state management unit 53 of the management system 50 communicates a record in the terminal management table that includes the host user ID "H_10da" and the destination terminal participant user ID "B_10ac" received together with the conference start request. Change the field part of the state. Specifically, the state management unit 53 changes the communication state of the record including the user ID "H_10da" in the terminal management table to "Calling". Similarly, the state management unit 53 changes the communication state of the record including the user ID "B_10ac" in the terminal management table to "Ring".

<Step S44>
Then, the session control unit 56 of the management system 50 generates a session ID for identifying a session (session sed for content data) for executing communication with the destination terminal requested by the host terminal, and generates a session ID. Register in the session management table of the session management DB 5003.

<Step S45>
Subsequently, the session control unit 56 hosts the generated session IDs in the field portions of the terminal ID of the host terminal (start request terminal in the session management table) and the terminal ID of the destination terminal in the session management table, respectively. The terminal ID "10da" of the terminal and the terminal ID "10ac" of the destination terminal are stored and managed.

<Step S46>
Then, the conference management unit 59 of the management system 50 puts the host in the field of the record participants (participants currently participating in the conference) including the host as the participation authority owner in the conference management table of the conference management DB 5004. Register the user ID "H_10da". Further, the extraction unit 54 of the management system 50 extracts the user IDs of participants other than the host registered in the participation authority owner of the record from the conference management table.

<Step S47>
Next, the communication unit 51 transmits the session ID generated by the session control unit 56 to the host terminal.

<Step S48>
In addition, the communication unit 51 transmits the host user ID "H_10da", the session ID, and the IP address of the management system 50 to the communication terminal 10ac, which is the destination terminal, together with the conference start request. In reality, the communication unit 51 identifies the conference start request, the host user ID "H_10da", the session ID, and the IP address of the management system 50 by the user ID extracted by the extraction unit 54 in step S46. It is transmitted to the communication terminal 10 of all the participants. As a result, the destination terminal receives the conference start request and grasps the IP address "1.1.1.2" of the management system 50.

<Step S49>
When the communication unit 11 of the destination terminal receives the conference start request, the display control unit 14 causes the display 120 to display a start request dialog box 1200-1 indicating that the conference start request as shown in FIG. 17 has been received. The start request dialog box 1200-1 shown in FIG. 17 indicates that the conference start request has been received, and indicates whether or not to start communication with the host terminal (establish a session) and allow participation in the conference. A user interface for specifying. The user can confirm that the conference start request has been received by viewing the start request dialog box 1200-1. The Start Request dialog box 1200-1 has a "Yes" button 1200-2 to allow participation in the meeting and a "No" button 1200-3 to select not to allow participation in the meeting. include.

<Step S50>
When the "Yes" button 1200-2 is pressed by operating the input device 108 of the destination terminal, the operation input receiving unit 12 starts communication with the host terminal (establishes a session) and participates in the conference. Accepts the response.

<Step S51>
Next, the communication unit 11 of the destination terminal sends the user ID "B_10ac" of the participant of the destination terminal, the user ID "H_10da" of the host, and the session ID to the management system 50 together with the start response indicating participation in the conference. Send.

<Step S52>
When the conference management unit 59 of the management system 50 receives the start response from the communication unit 51, in the conference management table of the conference management DB 5004, the participants (participants currently participating in the conference) include the host. The user ID "B_10ac" of the participant of the destination terminal is registered in the participant's field. As a result, the participants of the destination terminal are treated as if they are actually participating in the same conference as the host, and the communication terminal 10ac, which is the destination terminal, functions as a guest terminal and uses the communication terminal 10ac. Participants are guests of the conferences they attend.

<Step S53>
When the communication unit 51 of the management system 50 receives the start response, the state management unit 53 includes the host user ID “H_10da” and the guest user ID “B_10ac” received together with the start response in the terminal management table, respectively. Change the field part of the communication status of the record. Specifically, the state management unit 53 changes the communication state of the record including the user ID "H_10da" in the terminal management table to "Accepted". Similarly, the state management unit 53 changes the communication state of the record including the user ID "B_10ac" in the terminal management table to "Accepted".

<Step S54>
Next, the communication unit 51 transmits the guest user ID "B_10ac" and the session ID to the host terminal together with the start response.

<Steps S55 and S56>
When the host terminal receives this start response, the communication unit 11 transmits the session ID to the management system 50 to establish the session. On the other hand, the guest terminal establishes a session by transmitting the session ID to the management system 50 by the communication unit 11. When the session is established between the host terminal and the guest terminal in this way, the display control unit 14 of the host terminal displays, for example, the conference screen 1300H shown in FIG. 18 on the display 120. Further, the display control unit 14 of the guest terminal also causes the display 120 to display a screen similar to the conference screen 1300H (conference screen 1600G described later).

The conference screen 1300H shown in FIG. 18 includes a participant video 1300H-1 which is a video of a participant who is actually participating in a conference hosted by a participant with the user ID “H_10da”, and himself (here, a host). The self-image 1300H-2, which is the image of the above, the group conference start button 1300H-3, and the conference exit button 1300H-4 for leaving the conference (general conference) are included. In the example shown in FIG. 18, each participant whose user ID is "A_10aa", "B_10ac", "C_10ad", "D_10ae", "E_10ba", "F_10bb" and "G_10cc" is a guest in the conference. It shows the state of actually participating. The details of the operation when the group conference start button 1300H-3 is pressed will be described later with reference to FIG. 19 and the like.

<Steps S57 to S60>
When a session is established between the host terminal and the guest terminal by steps S55 and S56, video data and audio data are transmitted to and received from each other via the management system 50, and video is transmitted throughout the conference including the host terminal and each guest terminal. Meetings are possible.

(Group meeting start processing)
FIG. 19 is a sequence diagram showing an example of a group conference start process in the communication system according to the embodiment. FIG. 20 is a diagram showing an example of a group selection screen. FIG. 21 is a diagram showing an example of a group meeting status screen immediately after the start of the group meeting. FIG. 22 is a diagram showing an example of a group meeting start request dialog box. FIG. 23 is a diagram showing an example of a conference screen (host) of a general conference when a specific participant enters a group conference. FIG. 24 is a diagram showing an example of a group meeting status screen when a specific participant enters the group meeting. The start processing of the group conference in the communication system 1 according to the present embodiment will be described with reference to FIGS. 19 to 24. Hereinafter, a case where the communication terminal 10ac receives the group conference start request transmitted by the host terminal (communication terminal 10da) as the guest terminal will be described.

<Steps S71, S72>
First, the host of the host terminal (communication terminal 10da) presses the group conference start button 1300H-3 in order to start the group conference via the input device 108 on the conference screen 1300H shown in FIG. Then, the communication unit 11 of the host terminal sends a conference participant acquisition request to the management system 50 for requesting the acquisition of the participant information of the guest who is currently participating in the conference (general conference) in which the host is participating. Send.

<Steps S73, S74>
When the communication unit 51 of the management system 50 receives the conference participant acquisition request, the conference management unit 59 displays the field "participant" of the record of the conference to which the host is currently participating in the conference management table of the conference management DB 5004. From, the participant information (user ID) of the guest who is currently participating in the conference is acquired. Then, the conference management unit 59 transmits the acquired participant information (guest user ID) to the host terminal.

<Step S75>
When the conference participant information (guest user ID) is received by the communication unit 11 of the host terminal, the display control unit 14 selects a group for assigning a group to the display 120 for each guest as shown in FIG. Display the screen 1400H.

The group selection screen 1400H shown in FIG. 20 includes a group selection pull-down 1400H-1, a random distribution button 1400H-2, a group addition button 1400H-3, an OK button 1400H-4, and a group display unit 1400H-5. , Is included.

The group selection pull-down 1400H-1 is a pull-down for assigning each guest to any of the groups additionally set by the group addition button 1400H-3.

The random distribution button 1400H-2 is a button for randomly assigning each guest to each set group.

The group addition button 1400H-3 is a button for setting and adding a new group. The group display unit 1400H-5 is an area for displaying the group name set and added by the group addition button 1400H-3. In the example shown in FIG. 20, it is shown that two grapes of groups a and b are set.

The OK button 1400H-4 is a button for starting a group meeting after assigning each guest to any group.

<Step S76>
On the group selection screen 1400H, the host performs a selection operation for assigning each guest to any group via the input device 108. In the example shown in FIG. 20, it is shown that participants A_10aa, B_10ac, C_10ad, and D_10ae are assigned to group a, and participants E_10ba, F_10bb, and G_10cc are assigned to group b.

<Step S77>
Then, when the OK button 1400H-4 is pressed by the host via the input device 108, the communication unit 11 of the host terminal assigns each guest to which group together with the group conference start request indicating the request to start the group conference. Participant information (including the user ID of each guest) indicating whether or not the meeting has been completed is transmitted to the management system 50.

<Step S78>
When the communication unit 51 of the management system 50 receives the group conference start request, the conference management unit 59 generates a conference ID that identifies each group conference indicated by the participant information. For example, the conference management unit 59 generates the conference ID "Conf1-1" for the group a and the conference ID "Conf1-2" for the group b.

<Step S79>
For each conference ID of each generated group conference, the conference management unit 59 identifies the original conference of the group conference (here, "Conf1"), the conference name of the group conference, and the group conference. Create a new record in the conference management table that associates with the right holder for. Specifically, the user ID of the guest assigned to each group in step S76 is registered in the participant authority owner of the new record. At this point, the "participant" field in the record is empty because there are no guests currently participating in the group meeting.

<Steps S80, S81>
The communication unit 51 transmits a conference ID that identifies each group conference generated by the conference management unit 59 to the host terminal. As a result, the host terminal can manage each group conference using the received conference ID. When the conference ID is received by the communication unit 11 of the host terminal, the display control unit 14 causes the display 120 to display the group conference status screen 1500H showing the participation status of the guests of each group conference as shown in FIG.

The group meeting status screen 1500H shown in FIG. 21 includes a group a status display unit 1500H-1, a group b status display unit 1500H-2, a group a selection button 1500H-3, and a group b selection button 1500H-4. A group participation authority owner display unit 1500H-5, a mute button 1500H-7, an ice break selection button 1500H-8, and a group meeting end button 1500H-9 are included.

The group a status display unit 1500H-1 is an area for displaying the status of the participants who participated (entered) the group a. The group b status display unit 1500H-2 is an area for displaying the status of the participants who participated (entered) the group b. Although this is an example when two groups are set, it is naturally assumed that three or more groups are set, so the layout of the group status display unit is appropriately set according to the set number of groups. It should be.

The group a selection button 1500H-3 is a button for selecting the group a, and is a button for causing the audio output unit 16 of the host terminal to output the audio of the group conference of the group a. The group b selection button 1500H-4 is a button for selecting the group b, and is a button for causing the voice output unit 16 of the host terminal to output the voice of the group conference of the group b. In the example shown in FIG. 21, the group a is selected.

The group participation authority owner display unit 1500H-5 is an area for displaying the user ID of the guest belonging to the selected group (the participant authority owner of the group). By pressing the group a selection button 1500H-3 or the group b selection button 1500H-4, the display content of the group participation authority owner display unit 1500H-5 is switched to the display of the user ID of the guest of the selected group.

The mute button 1500H-7 is a button for muting the audio output of the group conference by the audio output unit 16. Further, when the mute button 1500H-7 is pressed in the mute state, the mute state is released, and the voice output unit 16 restarts the voice output of the group conference.

The ice break selection button 1500H-8 is a button for selecting and starting an ice break to be performed for each group meeting. The details of the operation of selecting and starting the ice break by pressing the ice break selection button 1500H-8 will be described later with reference to FIG. 25 and the like.

The group meeting end button 1500H-9 is a button for ending the group meeting being held at that time.

<Step S82>
When the information of each group conference is registered in the conference management table by the conference management unit 59 of the management system 50, the communication unit 51 receives the group conference start request and the conference ID of the group conference to which the guest terminal (communication terminal 10ac) belongs. , Send to the guest terminal. Actually, the communication unit 51 transmits the group conference start request and the conference ID of the group conference to all the guest terminals assigned to each group in step S76.

<Step S83>
When the communication unit 11 of the guest terminal receives the group conference start request, the display control unit 14 receives the group conference start request on the conference screen 1600G displayed on the display 120 of the guest terminal as shown in FIG. The start request dialog box 1600G-1 indicating is displayed. The start request dialog box 1600G-1 shown in FIG. 22 is a user interface for indicating that the group meeting start request has been received and specifying whether or not to allow participation (entry) in the group meeting. The user can confirm that the group meeting start request has been received by viewing the start request dialog box 1600G-1. The start request dialog box 1600G-1 has a "Yes" button 1600G-2 to allow participation in the group meeting (entry) and a "No" button to select not to allow participation in the group meeting. 1600G-3 and the like are included.

Further, the conference screen 1600G shown in FIG. 22 includes a self-image 1600G-4 which is an image of the guest himself / herself using the guest terminal, and an exit button 1600G-5 for leaving the group conference.

<Step S84>
When the "Yes" button 1600G-2 is pressed by operating the input device 108 of the guest terminal, the operation input receiving unit 12 receives a response to participate in the group meeting.

<Step S85>
Next, the communication unit 11 of the guest terminal transmits the user ID "B_10ac" of the guest of the guest terminal to the management system 50 together with the start response indicating participation in the group conference.

<Step S86>
When the start response is received by the communication unit 51, the conference management unit 59 of the management system 50 is a participant in the record of the group conference to which the guest of the guest terminal who sent the start response belongs in the conference management table of the conference management DB 5004. The user ID "B_10ac" of the guest is registered in the field of. Further, the conference management unit 59 deletes the user ID "B_10ac" of the guest from the participant field of the record of the original conference (general conference) indicated by the original conference ID of the record indicating the group conference. As a result, the participants (guests) of the guest terminal are treated as if they had left the plenary session and participated in the group conference.

<Step S87>
The communication unit 51 of the management system 50 transmits the participant information (guest user ID, etc.) of the guest terminal that has transmitted the start response to the host terminal.

<Step S88>
When the participant information is received by the communication unit 11 of the host terminal, the display control unit 14 displays the user ID included in the participant information from the conference screen 1300H indicating the state of the general conference as shown in FIG. Delete and update the video of the guest shown. In the example of the conference screen 1300H shown in FIG. 23, since the guest participant B_10ac participated in the group conference in step S86, the participant video 1300H-1 showing the participant B_10ac is deleted.

Then, as shown in FIG. 24, the display control unit 14 is the guest ID indicated by the user ID included in the participant information received by the communication unit 11 in the group a status display unit 1500H-1 of the group conference status screen 1500H. The participant video 1500H-1a, which is a video, is displayed and updated. In the example of the group conference status screen 1500H shown in FIG. 24, since the guest participant B_10ac participated in the group conference in step S86, the participant video 1500H-1a showing the participant B_10ac is added.

In the group meeting status screen 1500H shown in FIG. 24, the images of the participants who participated in each group meeting are displayed, but the present invention is not limited to this, and at least the information indicating the participants who participated in each group meeting is displayed. It should be displayed. For example, in the case of a participant who participated in a group meeting of group a, for example, a still image, a user ID, a user name, etc. of the participant who participated in the group a status display unit 1500H-1 participated in the group meeting of group a. It may be displayed as information indicating the participants who have participated.

<Step S89>
Further, the communication unit 51 of the management system 50 transmits the participant information (guest user ID, etc.) of the guest terminal that has transmitted the start response to the guest terminal itself. As a result, the guest terminal can recognize that the guest terminal has properly participated in the group meeting in the management system 50.

<Step S90>
When the participant information is received by the communication unit 11 of the guest terminal, the display control unit 14 shifts the conference screen 1600G displayed on the display 120 to the screen of the group conference. Specifically, the display control unit 14 displays the status of the group conference on the conference screen 1600G which has displayed the status of the general conference (displaying the participants participating in the general conference). Update to state. That is, in the guest terminal of the participant B_10ac, the image of the participant B_10ac itself is displayed on the conference screen 1600G by the display control unit 14.

<Steps S91, S92>
When the guest of the guest terminal participates in the group conference, the communication unit 11 of the host terminal can receive the video data and the audio data in the group conference, and the display control unit 14 of the host terminal participates in the group conference. The video of the guest who is present is displayed on the group conference status screen 1500H, and the audio output unit 16 outputs the audio spoken by the guest participating in the group conference.

As described above, when the guest terminal participates in the group conference in response to the group conference start request transmitted from the host terminal, the voice and participation in each group conference are displayed on the group conference status screen 1500H displayed on the host terminal. You can check the guests who are in the room, and you can check the progress of each group meeting.

(Operation to start an ice break)
FIG. 25 is a sequence diagram showing an example of an operation of starting an ice break in the communication system according to the embodiment. FIG. 26 is a diagram showing an example of an ice break selection screen. FIG. 27 is a diagram showing an example of a group meeting status screen during an ice break. FIG. 28 is a diagram showing an example of an ice break screen of a quiz game. The operation of starting the ice break in the communication system 1 according to the present embodiment will be described with reference to FIGS. 25 to 28. Hereinafter, the host terminal will be referred to as a communication terminal 10da, and the guest terminal will be referred to as a communication terminal 10aa.

<Steps S101 and S102>
First, the host of the host terminal (communication terminal 10da) presses the ice break selection button 1500H-8 in order to start the ice break on the group conference status screen 1500H shown in FIG. 24 via the input device 108. Then, the communication unit 11 of the host terminal transmits an ice break information acquisition request for requesting acquisition of all selectable ice break information to the management system 50.

<Steps S103, S104>
When the ice break information acquisition request is received by the communication unit 51 of the management system 50, the ice break management unit 60 sets the ice break ID and ice break name related to all the records in the ice break information management table of the ice break management DB 5005. , And the explanation contents are acquired as ice break information. In the ice break information management table, the screen layout transition described later, which is associated with the ice break ID, the ice break name, and the description content, is also included in the concept of ice break information. For example, in the case of the icebreaker information management table shown in FIG. 10, the icebreaker management unit 60 has an icebreaker ID "Conent1", "Conent2", an icebreaker name "quiz game", "introduction to others", and an explanation content " Acquire "Data1" and "Data2". Then, the communication unit 51 transmits the ice break information acquired by the ice break management unit 60 to the host terminal.

<Step S105>
When the ice break information is received by the communication unit 11 of the host terminal, the display control unit 14 displays the ice break selection screen 1700H (on the selection screen) for selecting the type of ice break as shown in FIG. 26 on the display 120. An example) is displayed. In this case, the ice break information received by the communication unit 11 is stored in the storage unit 18.

The ice break selection screen 1700H shown in FIG. 26 includes an ice break selection unit 1700H-1, an ice break explanation unit 1700H-2, and a start button 1700H-3.

The ice break selection unit 1700H-1 represents all the types of ice breaks that can be selected, and is an area in which it is possible to select which ice break to execute. Specifically, the ice break selection unit 1700H-1 displays the type of ice break by displaying a list of ice break names, and in the example shown in FIG. 26, "quiz game" is selected as the ice break. The state is shown. In the example shown in FIG. 26, "quiz game" and "introduction to others" are displayed as ice breakers, but the ice breakers are not limited to these, for example, "rock-paper-scissors" and the like. Various other icebreaker types may be displayed.

The ice break explanation unit 1700H-2 is an area for displaying the explanation content corresponding to the ice break selected by the ice break selection unit 1700H-1. Specifically, the display control unit 14 of the host terminal extracts the explanation content corresponding to the ice break selected by the ice break selection unit 1700H-1 from the ice break information received by the communication unit 11, and ice. It is displayed on the break explanation unit 1700H-2. In the example shown in FIG. 26, the state in which the explanation content corresponding to the “quiz game” as the ice break is displayed on the ice break explanation unit 1700H-2 is shown.

The start button 1700H-3 is a button for starting the ice break selected by the ice break selection unit 1700H-1.

<Steps S106, S107>
Then, when the start button 1700H-3 is pressed by the host via the input device 108, the communication unit 11 (transmission means, transmission unit, first transmission unit) of the host terminal requests the start of the ice break. Along with the icebreak start request (start request), the icebreak ID of the icebreak selected by the icebreak selection unit 1700H-1 and the conference ID of the general conference in which the host terminal participates (here, "Conf1") are displayed. Send to the management system 50. Here, it is assumed that the "quiz game" is selected as the ice break in the ice break selection unit 1700H-1.

<Steps S108, S109>
When the communication unit 51 of the management system 50 receives the ice break start request, the ice break management unit 60 uses the conference ID received by the communication unit 51 as the original conference ID as the conference ID of all the group conferences (here, """Conf1-1" and "Conf1-2") are acquired from the conference management table. Further, the ice break management unit 60 sets the screen layout (here, “Layout 1-1”) at the beginning of the screen layout transition (transition information) corresponding to the ice break ID (here, “Conent 1”) received by the communication unit 51. , Obtained from the icebreaker information management table. Then, the ice break management unit 60 adds a new record associating the acquired group conference ID, screen layout, and ice break ID to the ice break progress management table. In the status of the record added to the ice break progress management table by the ice break management unit 60, "Doing" indicating that the ice break has started and the ice break is in progress is registered.

<Steps S110, S111>
Then, the communication unit 51 of the management system 50 transmits the conference ID and status of the group conference included in each record added to the ice break progress management table by the ice break management unit 60 to the host terminal. As a result, the host terminal can manage each group conference by using the conference ID and the status of the received group conference. When the conference ID and status of the group conference are received by the communication unit 11 of the host terminal, the display control unit 14 (display control means) displays the display 120 (display device) on the display 120 (display device) as in the group conference status screen 1500H shown in FIG. 27. Indicate that each group meeting is on an ice break. Specifically, as shown in FIG. 27, the display control unit 14 causes the group a status display unit 1500H-1 and the group b status display unit 1500H-2 to display "ice break".

<Steps S112 and S113>
Further, the ice break management unit 60 acquires a screen layout (here, “Layout 1-1”) corresponding to the conference ID of the group conference to which the guest terminal (communication terminal 10aa) belongs from the ice break progress management table. Then, the communication unit 51 (second transmission unit) includes a layout change request (change request) for requesting a layout change of the screen displayed on the guest terminal, and a screen layout (layout) acquired by the ice break management unit 60. Information) is sent to the guest terminal.

<Step S114>
When the layout change request and the screen layout are received by the communication unit 11 of the guest terminal, the display control unit 14 of the guest terminal plays a quiz game as an ice break on the display 120 according to the screen layout. Display the ice break screen 1800G for.

The ice break screen 1800G shown in FIG. 28 includes a quiz question display unit 1800G-1, an answer display unit 1800G-2, a participant video 1800G-3, and an end button 1800G-4.

The quiz question display unit 1800G-1 is an area for displaying a quiz question for an ice break. The answer display unit 1800G-2 is an area for displaying the answer of the quiz input to the guest terminal by the guest (participant using the communication terminal 10aa). The participant image 1800G-3 is an area for displaying images of participants other than the guest in the group conference in which the guest is participating. The end button 1800G-4 is a button for confirming the answer entered by the guest.

The ice break screen 1800G shown in FIG. 28 shows a state in which each participant whose user IDs are “A_10aa”, “B_10ac”, “C_10ad”, and “D_10ae” participates as a guest in the grape conference during the ice break. Is shown.

With the above actions, preparations are made for starting the ice break (here, "quiz game") that is performed at the start of the group meeting. The specific operation of the ice break will be described later with reference to FIG. 29 and the like.

In the operation for starting the ice break described with reference to FIG. 26 and the like, the "quiz game" is taken as an example of the ice break, but for example, the operation for starting another ice break such as "introduction to others". Can be realized by the operation described with reference to FIG. 26 and the like.

(Ice break operation: quiz game)
FIG. 29 is a sequence diagram showing an example of an ice break operation of a quiz game in the communication system according to the embodiment. FIG. 30 is a diagram showing an example of an ice break screen in which self-answers are displayed. FIG. 31 is a diagram showing an example of an ice break screen in which all the answers are displayed. FIG. 32 is a diagram showing an example of a group meeting status screen when the group a finishes the ice break. The ice break operation of the quiz game in the communication system 1 according to the present embodiment will be described with reference to FIGS. 29 to 32.

<Steps S121, S122>
The guest of the guest terminal (communication terminal 10aa) is the answer of the quiz displayed on the quiz question display unit 1800G-1 via the input device 108 on the ice break screen 1800G shown in FIG. 28. Enter a part. Then, as shown in FIG. 30, the display control unit 14 of the guest terminal causes the answer display unit 1800G-2 to display the content of the input answer (here, “hi”).

<Step S123>
Then, when the end button 1800G-4 is pressed by the guest via the input device 108, the communication unit 11 of the guest terminal receives the answer data displayed on the answer display unit 1800G-2, the user ID of the guest, and the user ID of the guest. To the management system 50.

<Steps S124, S125>
When the answer data and the user ID are received by the communication unit 51 of the management system 50, the ice break management unit 60 receives the user ID received by the communication unit 51 and the conference ID of the group conference to which the user ID belongs (here, the conference ID of the group conference to which the user ID belongs). A new record that associates "Conf1-1") with the answer data is added to the icebreaker answer management table. Then, the ice break management unit 60 refers to the record registered in the ice break answer management table, and determines whether or not the answer data of all the participants (guests) participating in the group meeting is registered. To do.

<Step S126>
When the answer data of all the participants participating in the group meeting is registered in the ice break answer management table, the ice break management unit 60 corresponds to the meeting ID of the group meeting in the ice break progress management table. Refer to the screen layout. Then, the ice break management unit 60 determines and acquires the screen layout that transitions to the next to the referenced screen layout by referring to the ice break information management table. Specifically, the ice break management unit 60 refers to the screen layout transition corresponding to the quiz game of the ice break information management table, and refers to the screen layout "Layout 1-1" obtained by referring to the ice break progress management table. The screen layout "Layout 1-2" to be transitioned next is acquired from the screen layout transition. Then, the ice break management unit 60 updates the screen layout corresponding to the conference ID of the group meeting in the ice break progress management table with the screen layout (here, "Layout 1-2") acquired from the ice break information management table. To do.

<Step S127>
Then, the communication unit 51 of the management system 50 includes the screen layout acquired by the ice break management unit 60 and all of the grape conferences, together with the layout change request for requesting the layout change of the screen displayed on the guest terminal. Send the answer data of the participants to the guest terminal.

<Step S128>
When the layout change request, the screen layout, and the answer data are received by the communication unit 11 of the guest terminal, the display control unit 14 of the guest terminal displays the display 120 with only its own answer as shown in FIG. 31 according to the screen layout. The ice break screen 1800G that displays the answer contents of other participants is displayed. As a result, the guest who participated in the quiz game as an ice break can confirm the answers of other participants as well as their own answers, and the final answer to the quiz question displayed on the quiz question display unit 1800G-1. Can be confirmed.

The ice break screen 1800G shown in FIG. 31 includes a quiz question display unit 1800G-1, an answer display unit 1800G-2, an answer display unit 1800G-5, and an end button 1800G-4. The difference from the ice break screen 1800G shown in FIG. 28 is that the participant video 1800G-3 is replaced by the answer display unit 1800G-5. The answer display unit 1800G-5 is an area for displaying the answers of participants participating in the group conference other than the guest of the guest terminal.

The ice break screen 1800G shown in FIG. 31 shows a state in which the answers of the participants whose user IDs are "A_10aa", "B_10ac", "C_10ad", and "D_10ae" are displayed.

<Steps S129 and S130>
Then, when the end button 1800G-4 is pressed by the guest via the input device 108, the communication unit 11 of the guest terminal transmits the user ID of the guest to the management system 50.

<Step S131>
When the user ID is received by the communication unit 51 of the management system 50, the ice break management unit 60 deletes the record corresponding to the user ID in the ice break answer management table. Here, since the guest user ID is "A_10aa", the ice break management unit 60 deletes the record corresponding to the user ID. Similarly, when the ice break management unit 60 receives the user ID from the communication terminal 10 of another participant of the group conference in which the guest is participating, the ice break management unit 60 deletes the record corresponding to the user ID in the ice break answer management table. To do.

Then, when the records of all the participants participating in the group meeting are deleted in the ice break answer management table, the ice break management unit 60 displays the screen corresponding to the meeting ID of the group meeting in the ice break progress management table. Refer to the layout. Then, the ice break management unit 60 determines and acquires the screen layout that transitions to the next to the referenced screen layout by referring to the ice break information management table. Here, if there is no screen layout for the next transition from the ice break information management table, the ice break management unit 60 empties the screen layout corresponding to the conference ID of the group meeting in the ice break progress management table, and status. Is updated to "Done". For example, in the ice break information management table shown in FIG. 10, two screen layouts are registered in the screen layout transition corresponding to the ice break ID "Conent1" indicating the "quiz game", and the screen layout "Layout1" is registered. It shows that the screen layout of the next transition destination of "-2" does not exist.

<Step S132>
If there is no screen layout to transition from the ice break information management table to the next, the ice break management unit 60 determines that the ice break of the group meeting has ended, and the communication unit 51 determines that the meeting screen of the normal group meeting has ended. A layout change request requesting the transition to 1600G is transmitted to the guest terminal.

<Step S133>
When the layout change request is received by the communication unit 11 of the guest terminal, the display control unit 14 of the guest terminal causes the display 120 to display the conference screen 1600G of the group conference.

<Steps S134, S135>
Then, the communication unit 51 of the management system 50 transmits the conference ID (“Conf1-1”) and the status (“Done”) corresponding to the group conference in the ice break progress management table to the host terminal. When the conference ID and status of the group conference are received by the communication unit 11 of the host terminal, the display control unit 14 displays the group conference (here, "here,"" The display of "during ice break" is deleted to indicate that the ice break of group a ") has ended. As a result, the host terminal can confirm that the ice break started in the group meeting has ended. In addition, the participants of the group meeting will be able to attend the video conference in a state where the tension is eased by the executed ice break.

(Icebreak operation: Introducing others)
FIG. 33 is a sequence diagram showing an example of an ice break operation of self-introduction in the communication system according to the embodiment. FIG. 34 is a diagram showing an example of a conference screen (guest) of a group conference. FIG. 35 is a diagram showing an example of an ice break screen for introducing others. The ice break operation of introducing another person in the communication system 1 according to the present embodiment will be described with reference to FIGS. 33 to 35.

<Step S141>
The conference screen 1600G shown in FIG. 34 is displayed on the display 120 of the guest terminal (communication terminal 10aa) before the operation of starting the ice break is performed on the host terminal.

The conference screen 1600G shown in FIG. 34 includes a self-image 1600G-4, an exit button 1600G-5, and a participant image 1600G-6. The self-portrait 1600G-4 and the exit button 1600G-5 are as described above. Participant video 1600G-6 is a video of participants other than guests among the participants participating in the group conference.

Then, by the same operation as the operation of starting the ice break shown in FIG. 25 above, the host terminal selects the introduction of another person as the ice break, and when the ice break is started, the display control unit 14 of the guest terminal 14 Displays an ice break screen 1900G for one-on-one self-introduction, which is a stage before introducing another person as an ice break as shown in FIG. 35. Here, the display control unit 14 displays the ice break screen 1900G according to the screen layout “Layout2-1” for introducing others received from the management system 50.

The ice break screen 1900G shown in FIG. 35 includes a self-image 1900G-1, an opponent image 1900G-2, and an end button 1900G-3.

The self-image 1900G-1 is an area for displaying the image of the guest (self). The other party video 1900G-2 is an area for displaying the video of a participant who is a target of self-introduction and who is a participant of the same group meeting who introduces himself / herself in the previous stage. The end button 1900G-3 is a button for ending self-introduction, which is a stage before introducing another person as an ice breaker.

Then, the guest and the participants displayed on the other party's video 1900G-2 introduce themselves to each other via the ice break screen 1900G. Participants who will introduce themselves to each other with the guest may be randomly selected at the timing when the ice break starts, or the ice break selection screen 1700H shown by the host in FIG. 26 or the like. The combination of self-introduction may be arbitrarily determined on the screen.

<Steps S142, S143>
When the guest presses the end button 1900G-3 via the input device 108 after self-introduction with the participant to whom the guest is the other party is completed, the communication unit 11 of the guest terminal manages the user ID of the guest. Send to 50.

<Step S144>
When the user ID is received from the communication terminals 10 of all the participants participating in the group meeting, the ice break management unit 60 refers to the screen layout corresponding to the meeting ID of the group meeting in the ice break progress management table. To do. Then, the ice break management unit 60 determines and acquires the screen layout that transitions to the next to the referenced screen layout by referring to the ice break information management table. Here, if there is no screen layout for the next transition from the ice break information management table, the ice break management unit 60 empties the screen layout corresponding to the meeting ID of the group meeting in the ice break progress management table, and status. Is updated to "Done". For example, in the ice break information management table shown in FIG. 10, only one screen layout is registered in the screen layout transition corresponding to the ice break ID "Conent2" indicating "introduction to others", and the screen layout. It shows that the screen layout of the next transition destination of "Layout2-1" does not exist.

<Step S145>
If there is no screen layout to transition from the ice break information management table to the next, the ice break management unit 60 determines that the ice break of the group meeting has ended, and the communication unit 51 determines that the meeting screen of the normal group meeting has ended. A layout change request requesting the transition to 1600G is transmitted to the guest terminal.

<Step S146>
When the layout change request is received by the communication unit 11 of the guest terminal, the display control unit 14 of the guest terminal causes the display 120 to display the conference screen 1600G of the group conference.

<Steps S147, S148>
Then, the communication unit 51 of the management system 50 transmits the conference ID (“Conf1-2”) and the status (“Done”) corresponding to the group conference in the ice break progress management table to the host terminal. When the conference ID and status of the group conference are received by the communication unit 11 of the host terminal, the display control unit 14 displays the group conference (here, as shown in the group conference status screen 1500H shown in FIG. 32 above) on the display 120. Then, in order to indicate that the ice break of "group a") has ended, the display of "during ice break" is deleted. As a result, the host terminal can confirm that the ice break started in the group meeting has ended.

As described above, in the communication system 1 according to the present embodiment, the screen on the guest terminal side is changed according to the ice break information such as the screen layout corresponding to each ice break, so that the type of ice break can be selected in the video conferencing system. You can make an ice break by laying out the screen according to the screen layout.

Further, in the communication system 1, since an arbitrary ice break can be selected from a plurality of types of ice breaks on the host terminal, it is possible to perform an ice break according to the situation of the video conference, and the video conference can be performed. Usability can be improved.

Although the case where the ice break operation in the communication system 1 according to the above-described embodiment is performed in each group conference separated from the general conference has been described, the present invention is not limited to this. That is, the above-mentioned ice break operation can be performed in the plenary session before being divided into group meetings.

Further, in the communication system 1 according to the above-described embodiment, one ice break selected on the ice break selection screen 1700H shown in FIG. 26 is started for a plurality of group meetings, but the present invention is limited to this. It's not something. That is, a different ice break may be assigned and executed for each group meeting on the ice break selection screen 1700H. In this case, as shown in the ice break progress management table of FIG. 11, since the ice break ID is managed for each conference ID, a different ice break is executed for each group conference specified by each conference ID and the progress is made. It is possible to manage. As a result, it is possible to select and execute an appropriate ice break for each group meeting based on the situation of each group meeting, the state of the guests participating, and the like. However, in this case, it goes without saying that it is possible to assign the same ice break to a plurality of group meetings.

(Another form of software configuration of communication terminal)
FIG. 36 is a diagram showing an example of a software configuration when using the Web application of the communication terminal according to the embodiment. Another form of the software configuration of the communication terminal 10 will be described with reference to FIG. 36.

In FIG. 4 described above, the operation of executing the communication application A on the communication terminal 10 has been described, but the same processing can also be realized by the Web application. The Web application operates on a browser, for example, a program by Javascript (registered trademark) and a program on the Web server side cooperate with each other, and the user uses it on the browser. That is, as shown in FIG. 36, the communication terminal 10 downloads the program WA (HTML (HyperText Markup Language) + JavaScript + CSS (Cascading Style Sheets), etc.) from the management system 50 and executes it on the browser 1040. The browser 1040 operates according to the control of the OS 1020.

The communication terminal 10 can use the service provided by the management system 50 by transmitting and receiving data to and from the management system 50 using a protocol such as HTTP (Hypertext Transfer Protocol) or HTTPS (Hypertext Transfer Protocol). In such a usage pattern, it is not necessary to download the communication application A to the communication terminal 10 in advance.

It should be noted that each function of the above-described embodiment can be realized by one or a plurality of processing circuits. Here, the "processing circuit" is a processor programmed to execute each function by software like a processor implemented by an electronic circuit, an ASIC designed to execute each function described above, and a DSP (Digital Signal). It shall include devices such as Processor), FPGA, System on a Chip (Soc), GPU (Graphics Processing Unit), and conventional circuit modules.

Further, in the above-described embodiment, when at least one of the functional units of the communication terminal 10 and the management system 50 is realized by executing a program, the program is provided by being incorporated in a ROM or the like in advance. Further, the program executed by the communication terminal 10 and the management system 50 according to the above-described embodiment is a CD-ROM (Compact Disk Read Only Memory) or a flexible disk (FD) in an installable format or an executable format file. , CD-R (Compact Disk-Recordable), DVD or SD card, etc., may be configured to be recorded and provided on a computer-readable recording medium. Further, the program executed by the communication terminal 10 and the management system 50 according to the above-described embodiment is stored on a computer connected to a network such as the Internet and provided by downloading via the network. May be good. Further, the program executed by the communication terminal 10 and the management system 50 according to the above-described embodiment may be configured to be provided or distributed via a network such as the Internet. Further, the program executed by the communication terminal 10 and the management system 50 according to the above-described embodiment has a module configuration including at least one of the above-mentioned functional units, and the CPU is described above as the actual hardware. By reading a program from the storage device of the above and executing the program, each of the above-mentioned functional units is loaded on the main storage device and generated.

1 Communication system 2 Communication network 2a to 2d LAN
2ab, 2cd leased line 2i Internet 10, 10aa, 10ab, 10ac, 10ba, 10bb, 10ca, 10cab, 10da, 10db Communication terminal 11 Communication unit 12 Operation input reception unit 13 Imaging unit 14 Display control unit 15 Voice input unit 16 Audio output Unit 17 Storage / Reading unit 18 Storage unit 19 Authentication request unit 50 Management system 51 Communication unit 52 Authentication unit 53 Status management unit 54 Extraction unit 55 Terminal status acquisition unit 56 Session control unit 57 Storage / reading unit 58 Storage unit 59 Conference management unit 60 Ice break management unit 70, 70a to 70d, 70ab, 70cd router 90 Program providing system 101 CPU
102 ROM
103 RAM
105 Auxiliary storage 106 Media 107 Media drive 108 Input device 110 Bus line 111 Network I / F
112 Camera 112c Cable 113 Image sensor I / F
114 Microphone 114c cable 115 Speaker 115c cable 116 Audio input / output I / F
119 Display I / F
120, 120aa, 120bb, 120ca, 120db display 120c cable 201 CPU
202 ROM
203 RAM
205 Auxiliary storage 206 Recording media 207 Media drive 208 Display 209 Network I / F
210 Bass Line 211 Keyboard 212 Mouse 213 DVD
214 DVD drive 1010 work area 1020 OS
1040 Browser 5001 Authentication Management DB
5002 Terminal management DB
5003 Session management DB
5004 Conference management DB
5005 Icebreaker management DB
A communication app WA program

Japanese Patent No. 6269609

Claims (10)

Computer,
An acquisition means for acquiring ice break information related to an ice break to be executed in a video conference realized by transmitting and receiving audio signals to and from a communication terminal and another communication terminal via a network from a management system.
By transmitting a start request for starting the ice break specified in the ice break information to the management system by the other communication terminal, the screen is displayed by the layout information corresponding to the ice break included in the ice break information. A transmission means for transmitting a change request for changing the layout of the above to the other communication terminal from the management system.
A display control means for displaying the progress of an ice break executed on the other communication terminal on a display device, and
A program to make it work. The ice break information includes transition information that defines a transition of the screen layout.
The transmission means transmits the start request to the management system, so that the change request requesting a change in screen layout according to the transition information is transmitted from the management system to the other communication terminal. The program described in. The program according to claim 1 or 2, wherein the display control means causes the display device to display a selection screen for selecting from a plurality of types of ice breakers. The icebreaker information includes an explanation of the icebreaker.
The program according to claim 3, wherein the display control means displays the description content corresponding to the ice break selected on the selection screen. When the plurality of other communication terminals participating in the video conference are divided into a plurality of group conferences, the display control means displays the progress of the ice break on the display device for each group conference. The program according to any one of claims 1 to 4. The display control means can assign a different ice break to each of the group conferences when the plurality of other communication terminals participating in the video conference are divided into a plurality of group conferences. The program according to claim 3 or 4, wherein the screen is displayed on the display device. It is a communication method of a communication terminal capable of making a call by video conferencing by transmitting and receiving an audio signal via a network with another communication terminal.
The acquisition step of acquiring the icebreaker information about the icebreaker to be executed in the video conference from the management system, and
By transmitting a start request for starting the ice break specified in the ice break information to the management system by the other communication terminal, the screen is displayed by the layout information corresponding to the ice break included in the ice break information. A transmission step of transmitting a change request for changing the layout of the above from the management system to the other communication terminal, and
A display control step for displaying the progress of the ice break executed on the other communication terminal on the display device, and
Communication method with. A communication terminal capable of making a video conference call by transmitting and receiving an audio signal to and from another communication terminal via a network.
An acquisition unit that acquires ice break information related to the ice break to be executed in the video conference from the management system, and
By transmitting a start request for starting the ice break specified in the ice break information to the management system by the other communication terminal, the screen is displayed by the layout information corresponding to the ice break included in the ice break information. A transmission unit that causes the management system to transmit a change request for changing the layout of the above to the other communication terminal.
A display control unit that displays the progress of an ice break executed on the other communication terminal on a display device,
Communication terminal equipped with. A communication system having a communication terminal capable of making a call by video conferencing by transmitting and receiving voice signals via a network with another communication terminal, and a management system for managing the video conferencing.
The management system includes a storage unit that stores ice break information regarding an ice break executed in the video conference.
The communication terminal is
The acquisition unit that acquires the ice break information from the management system,
A first transmission unit that transmits a start request for starting an ice break specified by the ice break information to the management system on the other communication terminal, and a first transmission unit.
With
The management system
In response to the start request transmitted from the first transmission unit, a change request for requesting a change in screen layout based on the layout information corresponding to the ice break included in the ice break information is sent to the other communication terminal. Further equipped with a second transmitter for transmission,
The communication terminal is a communication system further provided with a display control unit for displaying the progress of an ice break executed by the other communication terminal on a display device. The communication system according to claim 9, wherein the second transmission unit transmits a request for transitioning to the original screen of the video conference at the other communication terminal after the end of the ice break to the other communication terminal.

Images