JP2016195389A - Communication management system, communication system, communication management method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which: when a communication terminal communicates with another communication terminal in the same group, since the communication terminal needs to disconnect a communication session and newly establish a communication session being used by another group, the communication terminal cannot quickly have a conversation with a communication terminal in the other group.SOLUTION: A communication management system displays an image of a partner actively having a telephone conversation relatively largely and displays an image of a partner passively having a telephone conversation relatively small in the same communication session, and enables a user who wants to actively communicate with the partner being displayed small, to actively communicate by switching a screen layout. The configuration is effective in that a user can quickly perform communication with a user in another group.SELECTED DRAWING: Figure 17

Description

  The present invention relates to a communication management system, a communication system, a communication management method, and a program.

  2. Description of the Related Art In recent years, video conferencing systems for conducting video conferences (also referred to as “video conferences”) with remote locations have become widespread in response to requests for reducing travel expenses and business trip times. In such a video conference system, conversation (communication) is realized by directly transmitting and receiving image data and sound data between communication terminals such as a plurality of video conference terminals (see Patent Document 1).

  However, when a conversation or the like is performed with another communication terminal in the same group, the communication session must be disconnected and newly established with a communication session in use by another group. There arises a problem that it is not possible to have a conversation or the like.

  The invention according to claim 1 is a communication management system for managing communication between the first and second communication terminals, wherein the first communication terminal identifies the first communication terminal from the first communication terminal. Receiving means for receiving identification information and second identification information for identifying the second communication terminal communicating in the same communication session as the first communication terminal; and the received first and An affiliation management means for managing second identification information in association with predetermined affiliation identification information for identifying a predetermined group, the associated first and second identification information, and the predetermined affiliation identification information And a transmission means for transmitting to the first and second communication terminals.

  As described above, according to the present invention, there is an effect that a conversation or the like can be quickly performed even in another group.

It is the schematic which showed the communication part of the video conference among the communication systems of this embodiment. It is a hardware block diagram of the video conference terminal which concerns on this embodiment. It is a hardware block diagram of the communication management system and relay apparatus which concern on this embodiment. It is a hardware block diagram of the electronic blackboard which concerns on this embodiment. It is a hardware block diagram of the smart phone or tablet terminal which concerns on this embodiment. It is a whole communication system lineblock diagram concerning this embodiment. It is each functional block diagram of the communication system which concerns on this embodiment. It is a conceptual diagram which shows a data management table. It is a conceptual diagram which shows an authentication management table. It is a conceptual diagram which shows a terminal management table. It is a conceptual diagram which shows a destination list management table. It is a conceptual diagram which shows an affiliation management table. It is the sequence diagram which showed the communication preparation process. It is an example of a screen showing a destination list. It is the sequence diagram which showed the communication method of the image and sound using a communication system. It is the sequence diagram which showed the transmission process of data ID. It is the figure which showed the example of a screen of a communication terminal. It is the sequence diagram which showed the process for creating a new group. It is the figure which showed the example of a screen of a communication terminal. It is the sequence diagram which showed the process for changing a group. It is the figure which showed the example of a screen of a communication terminal. It is the sequence diagram which showed the process which leaves a group. It is the figure which showed the example of a screen of a communication terminal. It is the sequence diagram which showed the process of broadcast. It is the figure which showed the example of a screen of a communication terminal.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

<< Overall configuration of communication system >>
First, a communication system 1 for conducting a video conference between a plurality of communication terminals will be described with reference to FIG. FIG. 1 is a schematic diagram showing a communication part of a video conference in the communication system of the present embodiment.

  It is sometimes called “video conference” instead of “video conference”. Further, here, a video conference will be described as an example, but it may be a simple conversation.

  The communication system 1 is constructed by a plurality of communication terminals, a relay device 30, and a communication management 50. The communication terminal performs communication by transmitting and receiving image data and sound data as an example of content data. In FIG. 1, a video conference terminal is shown as an example of the communication terminal 10, and an electronic blackboard is shown as an example of the communication terminal 70. The image of the image data may be a moving image or a still image, or both a moving image and a still image.

  A communication terminal as a request source that requests the start of a video conference or the like is represented as a “request source terminal”, and a communication terminal as a request destination (relay destination) is represented as a “destination terminal”. In FIG. 1, the communication terminal 10 is represented as a request source terminal, and the communication terminal 70 is represented as a destination terminal. However, when requesting the start of a video conference from the communication terminal 70, the communication terminal 70 becomes a request source terminal and the communication terminal 10 becomes a destination terminal. Each communication terminal can be used not only for communication between multiple offices and for communication between different rooms in the same office, but also for communication within the same room, and communication outdoors and indoors or outdoors and outdoors. May be used.

  The relay device 30 performs a process of relaying content data among a plurality of communication terminals. The communication management system 50 centrally manages login authentication from the communication terminal, management of the communication status of the communication terminal, management of the destination list, communication status of the relay device 30, and the like. The relay device 30 and the communication management system 50 may be constructed by a single computer, or may be constructed by a plurality of computers arbitrarily assigned by dividing each unit (function or means). .

  In the communication system 1, a management information session sei for transmitting and receiving various types of management information is established between the request source terminal and the destination terminal via the communication management system 50. Further, between the request source terminal and the destination terminal, four pieces of data of high resolution image data, medium resolution image data, low resolution image data, and sound data are transmitted and received via the relay device 30. Four sessions are established. In FIG. 1, these four sessions are collectively shown as an image / sound data session sed. Note that the image / sound data session sed does not necessarily have to be four sessions, and may have a smaller or larger number of sessions than the four sessions.

  Here, the resolution of the image data handled in the present embodiment will be described. The low-resolution image data includes, for example, 160 pixels in the horizontal direction and 120 pixels in the vertical direction, and becomes a base image. The medium resolution image data consists of 320 pixels in the horizontal direction and 240 pixels in the vertical direction. The high-resolution image data includes, for example, 640 pixels in the horizontal direction and 480 pixels in the vertical direction. Among these, when passing through a narrow band route, low-quality image data consisting only of low-resolution image data serving as a base image is relayed. When the band is relatively wide, low-resolution image data serving as a base image and medium-quality image data composed of medium-resolution image data are relayed. When the bandwidth is very wide, high-resolution image data composed of low-resolution image data serving as base image quality, intermediate-resolution image data, and high-resolution image data is relayed. Since the sound data has a smaller data amount than the image data, it is relayed even on a narrow band route.

<< Hardware Configuration of Embodiment >>
Next, the hardware configuration of this embodiment will be described.

<Hardware configuration of video conference terminal>
FIG. 2 is a hardware configuration diagram of the video conference terminal according to the present embodiment. As shown in FIG. 2, the video conference terminal as an example of the communication terminal 10 of this embodiment includes a CPU 101, a ROM 102, a RAM 103, a flash memory 104, an SSD 105, a media I / F 107, an operation button 108, and a power switch 109. , Bus line 110, network I / F 111, camera 112, image sensor I / F, microphone 114, speaker 115, sound input / output I / F 116, display I / F 117, external device connection I / F 118, short-range communication circuit 119, An antenna 119a of the near field communication circuit 119 is provided. Among these, a CPU (Central Processing Unit) 101 controls the overall operation of the communication terminal 10. A ROM (Read Only Memory) 102 stores a program used for driving the CPU 101 such as an IPL (Initial Program Loader). A RAM (Random Access Memory) 103 is used as a work area of the CPU 101. The flash memory 104 stores various data such as a communication program, image data, and sound data. An SSD (Solid State Drive) 105 controls reading or writing of various data with respect to the flash memory 104 according to the control of the CPU 101. An HDD may be used instead of the SSD. The media I / F 107 controls reading or writing (storage) of data with respect to the recording medium 106 such as a flash memory. The operation button 108 is a button operated when selecting a destination of the communication terminal 10. The power switch 109 is a switch for switching on / off the power of the communication terminal 10.

  A network I / F (Interface) 111 is an interface for performing data communication using the communication network 2 such as the Internet. The camera 112 is a type of built-in imaging means that captures an image of a subject under the control of the CPU 101 and obtains image data. The image sensor I / F 113 is a circuit that controls driving of the camera 112. The microphone 114 is a kind of built-in sound collecting means for inputting sound. The sound input / output I / F 116 is a circuit that processes input / output of a sound signal between the microphone 114 and the speaker 115 under the control of the CPU 101. The display I / F 117 is a circuit that transmits image data to the external display 120 under the control of the CPU 101. The external device connection I / F 118 is an interface for connecting various external devices. The short-range communication circuit 119 is a communication circuit such as NFC (Near Field Communication) (registered trademark) or Bluetooth (registered trademark).

  The bus line 110 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 101 shown in FIG.

  The display 120 is a kind of display means configured by a liquid crystal or organic EL that displays an image of a subject, an operation icon, and the like. The display 120 is connected to the display I / F 117 by a cable 120c. The cable 120c may be an analog RGB (VGA) signal cable, a component video cable, HDMI (High-Definition Multimedia Interface) (registered trademark), or DVI (Digital Video). Interactive) signal cable may be used.

  The camera 112 includes a lens and a solid-state image sensor that converts light into electric charges and digitizes a subject image (video). As the solid-state image sensor, a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled) is used. Device) or the like is used. External devices such as an external camera, an external microphone, and an external speaker can be connected to the external device connection I / F 118 by a USB (Universal Serial Bus) cable or the like. When an external camera is connected, the external camera is driven in preference to the built-in camera 112 under the control of the CPU 101. Similarly, when an external microphone is connected or when an external speaker is connected, each of the external microphones and the built-in speaker 115 is given priority over the internal microphone 114 and the internal speaker 115 according to the control of the CPU 101. An external speaker is driven.

  The recording medium 106 is detachable from the communication terminal 10. Further, as long as it is a non-volatile memory that reads or writes data according to the control of the CPU 101, not only the flash memory 104 but also an EEPROM (Electrically Erasable and Programmable ROM) or the like may be used.

<Hardware configuration of communication management system and relay device>
FIG. 3 is a hardware configuration diagram of the communication management system and the relay device according to the present embodiment. A server computer as an example of the communication management system 50 includes a CPU 501, ROM 502, RAM 503, HD 504, HDD (Hard Disk Drive) 505, recording medium 506, media I / F 507, display 508, network I / F 509, keyboard 511, mouse 512. , A CD-ROM drive 514, and a bus line 510.

  Among these, the CPU 501 controls the operation of the entire communication management system 50. The ROM 502 stores a program used for driving the CPU 501 such as IPL. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores various data such as a communication management program. An HDD (Hard Disk Drive) 505 controls reading or writing of various data to the HD 504 according to the control of the CPU 501. A media I / F 507 controls reading or writing (storage) of data with respect to a recording medium 506 such as a flash memory. The display 508 displays various information such as a cursor, menu, window, character, or image. A network I / F 509 is an interface for performing data communication using the communication network 2 such as the Internet. The keyboard 511 is a kind of input means having a plurality of keys for inputting characters, numerical values, various instructions, and the like. The mouse 512 is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. The CD-ROM drive 514 controls reading or writing of various data with respect to a CD-ROM (Compact Disc Read Only Memory) 513 as an example of a removable recording medium.

  The bus line 510 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 501 shown in FIG.

  Further, the hardware configuration of the relay device 30 shown in FIG. 1 is the same as the hardware configuration of the communication management system 50, and thus the description thereof is omitted. However, in the case of the relay device 30, the relay program is stored in the HD 504.

<Hardware configuration diagram of electronic blackboard>
FIG. 4 is a hardware configuration diagram of the electronic blackboard according to the present embodiment. As shown in FIG. 4, the electronic blackboard as an example of the communication terminal 70 includes a CPU 701, a ROM 702, a RAM 703, an SSD 704, a network controller 705, and an external storage controller 706 I / F.

  Among these, the CPU 701 controls the operation of the entire electronic blackboard. The ROM 702 stores a program used for driving the CPU 701 such as the CPU 701 and the IPL. The RAM 703 is used as a work area for the CPU 701. The SSD 704 stores various data such as an electronic blackboard program. The network controller 705 controls communication with the communication network 2. The external storage controller 706 controls communication with the USB memory 755 and external devices (camera 762, speaker 765, microphone 764).

  The electronic blackboard includes a capture device 711, a GPU 712, a display controller 713, a contact sensor 714, a sensor controller 715, an electronic pen controller 716, a short-range communication circuit 719, and an antenna 719a of the short-range communication circuit 719.

  Among these, the capture device 711 displays video information as a still image or a moving image on the display of the notebook PC 756. A GPU (Graphics Processing Unit) 712 is a semiconductor chip that specializes in graphics. The display controller 713 controls and manages screen display in order to output an output image from the GPU 712 to the display 753 and the like. The contact sensor 714 detects that the electronic pen 754, the user's hand H, or the like has touched the display 753. The sensor controller 715 controls processing of the contact sensor 714. The contact sensor 715 performs input of coordinates and detection of coordinates by an infrared blocking method. In this coordinate input and coordinate detection method, two light emitting / receiving devices (not shown) installed at both upper ends of the display 753 emit a plurality of infrared rays in parallel with the display 753, This is a method of receiving light that is reflected by the reflecting member provided on the light source and returns on the same optical path as the light path of the light emitted by the light receiving element. The contact sensor 714 outputs infrared ID (Identification) emitted from the two light receiving and emitting devices blocked by the object to the sensor controller 715, and the sensor controller 715 identifies the coordinate position that is the contact position of the object. The electronic pen controller 716 communicates with the electronic pen 754 to determine whether the display 753 is touched by the pen tip or the pen butt. The short-range communication circuit 719 is a communication circuit such as NFC (registered trademark) or Bluetooth (registered trademark).

  The bus line 710 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 701 shown in FIG.

  Note that the contact sensor 715 is not limited to the infrared blocking method, and a capacitive touch panel that identifies a contact position by detecting a change in capacitance, and a contact position is identified by a voltage change between two opposing resistance films. Various detection means such as a resistive film type touch panel that detects the electromagnetic induction generated when the contact object touches the display unit and identifies the contact position may be used. In addition, the electronic pen controller 716 may determine whether there is a touch on a part gripped by the user of the electronic pen 754 as well as a part of the other electronic pen, in addition to the pen tip and the pen butt of the electronic pen 754.

<Smartphone hardware configuration>
FIG. 5 is a hardware configuration diagram of the smartphone or tablet terminal according to the present embodiment. As shown in FIG. 5, the smartphone as an example of the communication terminal 90 includes a CPU 901, ROM 902, RAM 903, EEPROM 904, CMOS sensor 905, acceleration / direction sensor 906, media I / F 908, and GPS receiver 909. Yes.

  Among these, the CPU 901 controls the operation of the entire smartphone 90. The ROM 902 stores a program used for driving the CPU 901 such as the CPU 901 or IPL. The RAM 903 is used as a work area for the CPU 901. An EEPROM (Electrically Erasable and Programmable ROM) 904 reads or writes various data such as a communication terminal program under the control of the CPU 901. A CMOS (Complementary Metal Oxide Semiconductor) sensor 905 images a subject under the control of the CPU 901 to obtain image data. The acceleration / direction sensor 906 is various sensors such as an electronic magnetic compass, a gyrocompass, and an acceleration sensor that detect geomagnetism. A media I / F 908 controls reading or writing (storage) of data with respect to a recording medium 907 such as a flash memory. The GPS receiver 909 receives GPS signals from GPS satellites.

  In addition, the smartphone includes a long-distance communication circuit 911, a camera 912, an image sensor I / F 913, a microphone 914, a speaker 915, a sound input / output I / F 916, a display 917, an external device connection I / F 918, a short-distance communication circuit 919, An antenna 919a for a distance communication circuit and a touch panel 921 are provided.

  Among these, the long-distance communication circuit 911 is a circuit that communicates with other devices via the communication network 3 such as a mobile communication network. The camera 912 is a kind of built-in imaging unit that captures an image of a subject under the control of the CPU 901 to obtain image data. The image sensor I / F 913 is a circuit that controls driving of the camera 912. The microphone 914 is a kind of built-in sound collecting means for inputting sound. The sound input / output I / F 916 is a circuit that processes input / output of a sound signal between the microphone 914 and the speaker 915 under the control of the CPU 901. The display 917 is a kind of display means such as a liquid crystal display or an organic EL display that displays an image of a subject, various icons, and the like. The external device connection I / F 918 is an interface for connecting various external devices. The short-range communication circuit 919 is a communication circuit such as NFC (registered trademark) or Bluetooth (registered trademark). The touch panel 921 is a kind of input means for operating the smartphone when the user presses the display 917.

  The bus line 910 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 901 shown in FIG.

  Note that the communication terminal 90 may be not only a smartphone but also a smart watch, a mobile phone, a mobile game machine, or the like.

  Each of the above programs may be recorded in a computer-readable recording medium and distributed as a file in an installable or executable format. Examples of the recording medium include a CD-R (Compact Disc Recordable), a DVD (Digital Versatile Disk), a Blu-ray disc, and an SD card.

<< Overall configuration of communication system >>
Then, the whole structure of a communication system is demonstrated using FIG. FIG. 6 is an overall configuration diagram of a communication system according to the embodiment of the present invention.

  In FIG. 6, a communication terminal 10, a relay device 30, a communication management system 50, and a communication terminal 70 are connected to a communication network 2 including the Internet. The communication network 2 may include a wireless communication part. The communication terminal 10 is installed at the site A, and the communication terminal 70 is installed at the site D. For example, the base A is Japan and the base D is the UK. The communication terminal 90b is connected to the communication network 2 via a communication network 3 such as a base station 3b and a mobile communication network. The communication terminal 90c is connected to the communication network 2 via the base station 3c and the communication network 3. Thereby, each communication terminal, 90b, 90c, the relay apparatus 30, and the communication management system 50 can mutually communicate. In FIG. 6, the communication terminal 10 is the first communication terminal, and the communication terminal 70 is the second communication terminal.

<< Functional Configuration of Embodiment >>
Next, the functional configuration of this embodiment will be described with reference to FIGS. 2 to 5 and FIG. FIG. 7 is a functional block diagram of the communication system according to the present embodiment.

<Functional configuration of communication terminal 10>
The communication terminal 10 includes a transmission / reception unit 11, a reception unit 12, a communication control unit 13, a display control unit 14, a determination unit 15, a selection unit 16, an activation unit 17, an acquisition / providing unit 18, and a storage / reading processing unit 19. doing. Each of these units is a function realized by any of the constituent elements shown in FIG. 2 being operated by a command from the CPU 101 according to a communication program developed from the flash memory 104 onto the RAM 103, or It is a means to function. Further, the communication terminal 10 includes a storage unit 1000 constructed by the RAM 103 shown in FIG. 2 and the flash memory 104 shown in FIG.

(Each functional configuration of the communication terminal 10)
Next, each component of the communication terminal 10 will be described. The transmission / reception unit 11 is realized by a command from the CPU 101 illustrated in FIG. 2, a network I / F 111 and an external device connection I / F 118, and other terminals, devices, or systems and various data ( Or information). The transmission / reception unit 11 starts receiving state information indicating the state of each communication terminal as a destination candidate from the communication management system 50 before starting communication with another communication terminal. Note that this status information is not only the operation status of each communication terminal (ON line or OFF line status), but it is possible to communicate further on the ON line, whether the communication is in progress, or being away from the desk. It shows the detailed status such as whether or not there is. Below, the case where status information shows an operation state is demonstrated as an example.

  Further, the transmission / reception unit 11 also serves as a start unit, and performs processing for starting communication with another communication terminal such as the communication terminal 70.

  The receiving unit 12 is mainly realized by a command from the CPU 101 shown in FIG. 2, an operation button 108, and a power switch 109, and receives various inputs by a user.

  The communication control unit 13 is realized by the command from the CPU 101 shown in FIG. 2 and the camera 112 and the image sensor I / F 113, images a subject, and outputs image data obtained by the image capturing. Further, the communication control unit 13 is realized by an instruction from the CPU 101 and the voice input / output I / F 116 shown in FIG. 2. After the user's voice is converted into a voice signal by the microphone 114, this voice signal The sound data concerning is input. Further, the communication control unit 13 is realized by a command from the CPU 101 shown in FIG. 2 and the voice input / output I / F 116 shown in FIG. 2, and outputs a voice signal related to the sound data to the speaker. Sound is output from the speaker 115.

  The display control unit 14 combines the received image data with different resolutions realized by the command from the CPU 101 shown in FIG. 2 and the display I / F 117 shown in FIG. Control for transmitting data to the display 120 is performed. The display control unit 14 can transmit the destination list information received from the communication management system 50 to the display 120 and cause the display 120 to display the destination list.

  The determination unit 15 is realized by a command from the CPU 101 shown in FIG. 2 and makes various determinations.

  The selection unit 16 is realized by a command from the CPU 101 illustrated in FIG. 2, and performs various functions and communication applications (hereinafter referred to as “communication application”) according to a command from the reception unit 12 that has received a user instruction. Make a selection.

  The terminal identification information includes not only the terminal ID but also an IP address for accessing each communication terminal, an e-mail address to which each communication terminal is a destination, and a user for identifying the user of each communication terminal. ID and the user name which is the name of the user of each communication terminal are also included.

  The activation unit 17 is realized by a command from the CPU 101 illustrated in FIG. 2 and activates the communication application selected by the selection unit 16.

  The acquisition / providing unit 18 executes the command from the CPU 101 shown in FIG. 2 and the short-range communication circuit 119 and the antenna 119a, and acquires data by short-range wireless communication with other communication terminals. And offer.

  The storage / read processing unit 19 is executed by the instruction from the CPU 101 and the SSD 105 shown in FIG. 2, and stores various data in the storage unit 1000 or the recording medium 1100, or is stored in the storage unit 1000 or the recording medium 1100. A process of reading various data is performed. Furthermore, the storage unit 1000 overwrites and stores image data and sound data received when communicating with other communication terminals. Among these, an image is displayed on the display 120 by the image data before being overwritten, and sound is output from the speaker 115 by the sound data before being overwritten. The recording medium 1100 is realized by the recording medium 106 shown in FIG.

  Note that the terminal identification information of the present embodiment is an example of identification information such as language, characters, symbols, or various signs used to uniquely identify the communication terminals 10, 70 and the like. Further, the terminal identification information may be identification information in which at least two of the language, characters, symbols, and various indicia are combined. Further, a user ID for identifying the user may be used instead of the terminal ID. The terminal identification information includes not only the terminal ID but also a user ID for identifying the user and a terminal manufacturing number. The user ID also includes the user's name, my number based on the Japanese national number system, and the like.

<Functional configuration of relay device>
The relay device 30 includes a transmission / reception unit 31 that also serves as a transfer unit, a determination unit 32, a generation unit 33, and a storage / read processing unit 39. Each of these units is a function realized by any one of the constituent elements shown in FIG. 3 or a functioning means that is operated by an instruction from the CPU 501 according to the relay program expanded from the HD 504 to the RAM 503. It is. In addition, the relay device 30 includes a storage unit 3000 constructed by the RAM 503 and the HD 504 shown in FIG.

(Data management table)
FIG. 8 is a conceptual diagram showing a data management table. In the storage unit 3000, a data management DB 3001 configured by a data management table as shown in FIG. 8 is constructed. In this data management table, the data ID for specifying the transmission source and the IP address indicating the transmission source destination are associated and managed by being added to the image data and the sound data and transmitted from each communication terminal. Yes.

(Each functional configuration of the relay device)
Next, each functional configuration of the relay device 30 will be described in detail. In the following, in describing each functional configuration of the relay device 30, among the components illustrated in FIG. 3, the relationship with the main components for realizing each functional configuration of the relay device 30 is also described. explain.

  The transmission / reception unit 31 of the relay device 30 shown in FIG. 7 is realized by a command from the CPU 501 shown in FIG. 3 and the network I / F 509 shown in FIG. Various data (or information) is transmitted / received to / from other terminals, devices or systems. The transmission / reception unit 31 also serves as a transfer unit, and transfers image data and sound data transmitted from a predetermined communication terminal to another communication terminal.

  The determination unit 32 is realized by a command from the CPU 501 shown in FIG. 3, and determines a data delay state.

  The generation unit 33 is realized by an instruction from the CPU 501 illustrated in FIG. 3, and generates a unique data ID within one communication session. The data ID is attached to the image data and the sound data and transmitted from each communication terminal, so that the communication terminal that has received the image data and the sound data can determine the transmission source of the image data and the sound data. it can.

  The storage / reading processing unit 39 is realized by an instruction from the CPU 501 shown in FIG. 3 and the HDD 505 shown in FIG. 3, and stores various data in the storage unit 3000 or stored in the storage unit 3000. A process of reading various data is performed.

<Functional configuration of communication management system>
The communication management system 50 includes a transmission / reception unit 51, a determination unit 52, a creation unit 53, and a storage / read processing unit 59. Each of these units functions or functions realized by any one of the constituent elements shown in FIG. 7 operating according to a command from the CPU 501 according to the communication management program expanded from the HD 504 to the RAM 503. Means. Further, the communication management system 50 includes a storage unit 5000 constructed by the HD 504 shown in FIG.

(Authentication management table)
FIG. 9 is a conceptual diagram showing an authentication management table. In the storage unit 5000, an authentication management DB 5001 configured by an authentication management table as shown in FIG. 9 is constructed. In this authentication management table, each password is associated with each terminal ID of all communication terminals managed by the communication management system 50 and managed. For example, the authentication management table shown in FIG. 9 indicates that the terminal ID of the communication terminal 10aa which is a kind of the communication terminal 10 is “01aa” and the password is “aaaa”. The communication terminal 10aa is a type of the communication terminal 10 illustrated in FIG.

(Terminal management table)
FIG. 10 is a conceptual diagram showing a terminal management table. In the storage unit 5000, a terminal management DB 5002 configured by a terminal management table as shown in FIG. 10 is constructed. In this terminal management table, for each terminal ID of each communication terminal, a destination name when another communication terminal is set as a destination, an operating state of each communication terminal, and a log-in request information described later received by the communication management system 50 are received. The date and time and the IP address of the communication terminal are managed in association with each other. For example, in the terminal management table shown in FIG. 10, the terminal 10aa with the terminal ID “01aa” has the destination name “Japan Tokyo Office AA terminal” and the operating state “ON line (communicable)”. The date and time when the login request information is received by the communication management system 50 is “13:40 on April 10, 2015”, and the IP address of this terminal 10aa is “1.2.1.3”. It is shown. Note that the terminal ID, the destination name, and the IP address of the terminal are stored when each communication terminal pre-registers to receive service provided by the communication management system 50.

(Destination list management table)
FIG. 11 is a conceptual diagram showing a destination list management table. In the storage unit 5000, a destination list management DB 5003 configured by a destination list management table as shown in FIG. 11 is constructed. In this destination list management table, all terminal IDs of destination terminals registered as destination terminal candidates are managed in association with terminal IDs of request source terminals that request the start of communication. For example, in the destination list management table shown in FIG. 11, candidates for a destination terminal (terminal 10db) that can request the start of communication from a request source terminal (terminal 10aa) whose terminal ID is “01aa” are: It is shown that the terminal 10ab has a terminal ID “01ab”, the terminal 10ba has a terminal ID “01ba”, and the terminal 10bb has a terminal ID “01bb”. This destination terminal candidate is updated by being added or deleted by a request for addition or deletion from an arbitrary request source terminal to the management system 50.

  The destination list is an example of destination information, and the destination information is not in a list format, and information about destinations such as a terminal ID may be listed.

(Affiliation management table)
FIG. 12 is a conceptual diagram showing an affiliation management table. In the storage unit 5000, an affiliation management DB 5004 configured by an affiliation management table as shown in FIG. 12 is constructed. In this affiliation management table, for each terminal ID, an affiliation ID indicating a group to which the communication terminal indicated by this terminal ID belongs is associated and managed. This makes it possible to manage which communication terminal belongs to which group.

(Each functional configuration of the communication management system)
Next, each functional configuration of the communication management system 50 will be described in detail. In the following, in describing each functional configuration of the communication management system 50, among the respective components shown in FIG. 3, the main components for realizing each functional configuration of the communication management system 50 are described. Explain the relationship.

  The transmission / reception unit 31 of the communication management system 50 shown in FIG. 8 is realized by a command from the CPU 501 shown in FIG. 3 and the network I / F 509 shown in FIG. Various types of data (or information) are transmitted to and received from other terminals, devices, or systems.

  The determination unit 52 is realized by a command from the CPU 501 shown in FIG. 3 and makes various determinations.

  The creation unit 53 is realized by an instruction from the CPU 501 shown in FIG. 3 and creates an affiliation ID for identifying a group to which the communication terminal belongs in accordance with an instruction from each communication terminal.

  The storage / reading processing unit 59 is realized by a command from the CPU 501 illustrated in FIG. 3 and the HDD 505 illustrated in FIG. 3, and stores various data in the storage unit 5000 or stored in the storage unit 5000. A process of reading various data is performed.

<Functional configuration of communication terminal 70>
The communication terminal 70 includes a transmission / reception unit 71, a reception unit 72, a communication control unit 73, a display control unit 74, a determination unit 75, a selection unit 76, an activation unit 77, an acquisition / providing unit 78, and a storage / reading processing unit 79. doing. Each of these units functions or functions when any one of the components shown in FIG. 4 operates according to a command from the CPU 701 according to a communication program expanded from the SSD 704 to the RAM 703. Means. Further, the communication terminal 70 includes a storage unit 7000 constructed by the RAM 703 shown in FIG. 4 and the SSD 704 shown in FIG.

(Each functional configuration of the communication terminal 70)
Next, each component of the communication terminal 70 will be described. The transmission / reception unit 71 is realized by a command from the CPU 701 shown in FIG. 4, a network I / F 705 and an external device connection I / F 706, and various data ( Or information). The transmission / reception unit 71 starts receiving state information indicating the state of each communication terminal as a destination candidate from the communication management system 50 before starting communication with another communication terminal. Note that this status information is not only the operation status of each communication terminal (ON line or OFF line status), but it is possible to communicate further on the ON line, whether the communication is in progress, or being away from the desk. It shows the detailed status such as whether or not there is. In addition, the status information includes not only the operating state of each communication terminal, but also the cable 120c is disconnected from the communication terminal 10 at the communication terminal 10, the sound is output but the image is not output, or the sound is not output. Various states such as “MUTE” are shown. Below, the case where status information shows an operation state is demonstrated as an example.

  Further, the transmission / reception unit 71 also serves as a start unit, and performs processing for starting communication with another communication terminal such as the communication terminal 10.

  The accepting unit 72 is mainly realized by a command from the CPU 701 shown in FIG. 4, a contact sensor 715, and an electronic pen controller 716, and accepts various inputs by the user.

  The communication control unit 73 is realized by a command from the CPU 701 illustrated in FIG. 4, and performs image processing on image data obtained by the camera 762 imaging an object. The communication control unit 73 is realized by a command from the CPU 701. After the user's voice is converted into a voice signal by the microphone 764, voice processing is performed on the sound data related to the voice signal. Further, the communication control unit 73 is realized by a command from the CPU 701 illustrated in FIG. 4, and outputs a sound signal related to sound data to the speaker 765 and causes the speaker 765 to output sound.

  Further, the communication control unit 73 performs a process of converting drawing data drawn on the display 753 by the user with the electronic pen 754 or the hand H into coordinate data. When the communication terminal 70 transmits the coordinate data to the other communication terminal 70, the other electronic blackboard displays the same content drawing on the display 753 on the other electronic blackboard side based on the coordinate data.

  The display control unit 74 combines the command from the CPU 701 shown in FIG. 4 and the image data received by the display controller 713 shown in FIG. Is transmitted to the display 753. The display control unit 74 can transmit the destination list information received from the communication management system 50 to the display 753 and cause the display 753 to display the destination list.

  The determination unit 75 is realized by a command from the CPU 701 shown in FIG. 4 and determines whether or not another communication terminal is in proximity.

  The selection unit 76 is realized by a command from the CPU 701 shown in FIG. 4, and selects various functions and communication applications according to a command from the reception unit 72 that receives a user instruction.

  The activation unit 77 is realized by a command from the CPU 701 illustrated in FIG. 4 and activates the communication application selected by the selection unit 76.

  The acquisition / providing unit 78 executes the command from the CPU 701 shown in FIG. 4 and the short-range communication circuit 719 and the antenna 719a, and acquires data by short-range wireless communication with other communication terminals. And offer.

  The storage / reading processing unit 79 is executed by an instruction from the CPU 701 and the SSD 704 shown in FIG. 4, and stores various data in the storage unit 7000 or the recording medium 7100, or is stored in the storage unit 7000 or the recording medium 7100. A process of reading various data is performed. Further, the storage unit 7000 overwrites and stores image data and sound data received when performing communication with other communication terminals. Among these, an image is displayed on the display 753 by the image data before being overwritten, and sound is output from the speaker 765 by the sound data before being overwritten. The recording medium 7100 is realized by the USB memory 755 shown in FIG.

<Functional configuration of communication terminals 90b and 90c>
Since the communication terminals 90b and 90c have basically the same functional configuration, the mechanism configuration of the communication terminal 90b will be described, and the description of the functional configuration of the communication terminal 90c will be omitted. In addition, in the code | symbol which shows the function structure of the communication terminal 90b, and the code | symbol which shows the function structure of the communication terminal 90c, when it is the same except "b" and "b", it has the same function.

  The communication terminal 90b includes a transmission / reception unit 91b, a reception unit 92b, a communication control unit 93b, a display control unit 94b, a determination unit 95b, an acquisition / providing unit 98b, and a storage / reading processing unit 99b. Each of these units functions or functions when any one of the components shown in FIG. 5 is operated by a command from the CPU 901 according to a communication program expanded from the EEPROM 904 to the RAM 903. Means. Further, the communication terminal 90 has a storage unit 9000b constructed by the RAM 903 shown in FIG. 5 and the EEPROM 904 shown in FIG.

(Functional configuration of communication terminal)
Next, each component of the communication terminal 90b will be described. The transmission / reception unit 91b is realized by a command from the CPU 901 shown in FIG. 5 and a long-distance communication circuit 911 and an antenna 911a. The transmission / reception unit 91b communicates with other terminals, devices, or systems via the communication network 3 (such as call data). ).

  The accepting unit 92b is mainly realized by a command from the CPU 901 shown in FIG. 5 and a touch panel 921, and accepts various inputs by the user.

  The communication control unit 93b is realized by a command from the CPU 901 illustrated in FIG. 5 and an image sensor I / F 913, and performs image processing on image data obtained by the camera 912 capturing an image of a subject. The communication control unit 93b is realized by a command from the CPU 901 and a sound input / output I / F 916, and after the user's voice is converted into a voice signal by the microphone 914, the voice data related to the voice signal is processed. Perform audio processing. Further, the communication control unit 93b is realized by the instruction from the CPU 901 and the sound input / output I / F 916 shown in FIG. 5, and outputs a sound signal related to the sound data to the speaker 915 and outputs sound from the speaker 915. Let

  The display control unit 94b is realized by a command from the CPU 901 illustrated in FIG. 5 and performs control for displaying image data on the display 917.

  The determination unit 95b is realized by a command from the CPU 901 shown in FIG. 5, and performs determination of response contents to be described later.

  The acquisition / providing unit 98b is executed by the command from the CPU 901 shown in FIG. 5 and the short-range communication circuit 919 and the antenna 919a, and acquires and provides data by short-range wireless communication with the communication terminal. To do. The storage / reading processing unit 99c performs processing for storing various data in the recording medium 9100b and reading various data stored in the recording medium 9100b.

  The storage / reading processing unit 99b is executed by an instruction from the CPU 901 and the EEPROM 904 shown in FIG. 5, and stores various data in the storage unit 9000b and reads various data stored in the storage unit 9000b. I do.

<< Processing or Operation of Embodiment >>
Next, processing or operation in the communication system 1 according to the present embodiment will be described with reference to FIGS. First, the situation in the present embodiment will be briefly described.

  First, a process for preparing communication for a video conference between the communication terminals 10 and 70 will be described with reference to FIGS. 13 and 14. FIG. 13 is a sequence diagram illustrating communication preparation processing. FIG. 14 is an example of a screen showing a destination list.

  In order to simplify the description, only the communication terminal 10 and the communication terminal 70 are shown via the communication management system 50, but finally, the four communication terminals 10, 70, 70 shown in FIG. 90b and 90c communicate in the same communication session.

  First, when the user a operates the operation button 108 shown in FIG. 2 to request activation of a desired communication application among a plurality of communication applications, the reception unit 12 receives the activation request, A communication application is started (step S61). Then, the transmission / reception unit 11 transmits login request information indicating a login request to the communication management system 50 via the communication network 2 (step S62). The log-in request information includes a terminal ID for identifying the communication terminal 10 that is the own terminal, and a password. These terminal ID and password are data read from the storage unit 1000 via the storage / read processing unit 19 and sent to the transmission / reception unit 11.

  Next, the storage / read processing unit 59 of the communication management system 50 uses the terminal ID and password included in the login request information received via the transmission / reception unit 51 as a search key, and uses the authentication management table (see FIG. 9). The terminal authentication is performed by searching and determining whether the same terminal ID and the same password are managed (step S63). Since the same terminal ID and the same password are managed by the storage / reading processing unit 59, it is determined that the login request is from the communication terminal 10 in which the activation application having a valid usage right is installed. In the terminal management table (see FIG. 10), the storage / read processing unit 59 changes the field portion of the operating state of the record of the terminal ID received in step S62 to “ON line (communicable)”. At the same time, the reception date and time when the login request information is received in step S63 is stored in the field of reception date and time (step S64). Thereby, in the terminal management table, the terminal ID “01aa”, the operation state “online (communicable)”, the reception date and time “2015.4.10.13:40”, and the IP address “1.2.1.3” are displayed. "Will be managed in association with each other. Note that the IP address of the terminal is not registered in advance, but may be transmitted from the communication terminal 10aa in step S62.

  Then, the transmission / reception unit 51 of the communication management system 50 transmits the authentication result information indicating the authentication result obtained by the storage / read processing unit 59 via the communication network 2 to the request source terminal (communication). To the terminal 10) (step S65). In the present embodiment, the case where it is determined by the storage / reading processing unit 59 that the communication terminal has a valid use authority will be described below.

  When the transmission / reception unit 11 of the request source terminal (communication terminal 10) receives the authentication result information indicating the result determined to be a communication terminal having a valid use authority, the transmission / reception unit 11 transmits the communication network 2 via the communication network 2. Destination list request information indicating that a destination list is requested is transmitted to the communication management system 50 (step S66). Thereby, the transmission / reception unit 51 of the communication management system 50 receives the destination list request information.

  Next, the storage / reading processing unit 59 searches the destination list management table (see FIG. 11) using the terminal ID of the request source terminal (communication terminal 10) that requested the login as a search key, and requests the request source terminal (terminal 10). The terminal ID of the destination candidate (communication terminal 70 etc.) that can communicate with the terminal ID is read out, and the destination name corresponding to this terminal ID is read out from the terminal management table (see FIG. 10) (step S67). Here, the terminal ID of the destination candidate (70) corresponding to the terminal ID of the request source terminal (communication terminal 10) and the destination name corresponding to this are extracted.

  Next, the transmission / reception unit 51 of the communication management system 50 reads the data of the destination list frame and the icon data indicating the operating state from the storage unit 5000 via the storage / read processing unit 59 (step S68) and at the same time the destination list. The “destination list information (destination list frame, icon, terminal ID, destination name)” including the frame and icon, and the terminal ID and destination name read by the storage / reading processing unit 59 is sent to the request source terminal (communication terminal). 10) (step S69). Thereby, in the request source terminal (communication terminal 10), the transmission / reception unit 11 receives the destination list information, and the storage / reading processing unit 19 stores the destination list information in the storage unit 1000 (step S70).

  As described above, in this embodiment, instead of managing the destination list information in each communication terminal, the communication management system 50 centrally manages the destination list information of all the communication terminals. Therefore, a new communication terminal is included in the communication system 1, a new model communication terminal is included instead of the communication terminal already included, or the appearance of the destination list frame is changed. In this case, since the communication management system 50 handles all at once, it is possible to save the trouble of changing the destination list information on each communication terminal side.

  Further, the storage / reading processing unit 59 of the communication management system 50 searches the terminal management table (see FIG. 10) using the terminal ID of the above-mentioned read destination candidate as a search key, and operates corresponding to each terminal ID. By reading the status, each operating status of the communication terminal 70 or the like as the destination candidate is acquired (step S71).

  Next, the transmission / reception unit 51 transmits “terminal operation status information” including each terminal ID as a search key used in step S67 and the operation status of each corresponding destination terminal to the communication network 2. To the request source terminal (communication terminal 10) (step S72).

  Next, the storage / read processing unit 19 of the request source terminal (communication terminal 10) sequentially stores the terminal status information received from the communication management system 50 in the storage unit 1000 (step S73). Therefore, the request source terminal (communication terminal 10) receives the current state information of each communication terminal, so that the current terminal of the communication terminal 70 or the like that is a destination candidate that can communicate with the request source terminal (communication terminal 10). Each operating state can be acquired.

  Next, the display control unit 14 of the request source terminal (communication terminal 10) reflects the state of the communication terminal as a destination candidate based on the destination list information stored in the storage unit 1000 and the state information of the terminal. The display control unit 14 displays the destination list shown in FIG. 14 on the display 120 shown in FIG. 2 (step S74). An icon indicating the operating state is shown at the left end of each destination. In FIG. 14, the icons indicating the operating states of the communication terminals are “online (communication possible)”, “offline”, “online (communication possible)”, and “online (during communication)” from the top. Show.

  On the other hand, the storage / read processing unit 59 of the communication management system 50 searches the destination list management table (see FIG. 11) based on the terminal ID of the request source terminal (communication terminal 10) that has requested the login, thereby requesting the above request. The terminal IDs of other requesting terminals that have registered the terminal ID of the original terminal (communication terminal 10) as a destination candidate are extracted (step S75).

  Next, the storage / read processing unit 59 of the communication management system 50 searches the terminal management table (see FIG. 10) based on the terminal ID of the request source terminal (communication terminal 10) that has made the login request, and logs in. The operating state of the requesting terminal (communication terminal 10) that has requested is acquired (step S76).

  Then, the transmission / reception unit 51 includes the communication terminal 70 and the like associated with the terminal ID extracted in step S75, and the communication terminal 70 and the like whose operation state is “online” in the terminal management table (see FIG. 10). “Terminal status information” including the terminal ID of the request source terminal (communication terminal 10) acquired in step S76 and the operating status “online” is transmitted (step S77). When transmitting / receiving unit 51 transmits terminal status information to communication terminal 70 or the like, the IP address of the communication terminal managed in the terminal management table (see FIG. 10) is referred to based on each terminal ID. Thereby, the terminal ID of the request source terminal (communication terminal 10) that requested the log-in to each of the other destination terminals 70 and the like that can communicate the request source terminal (communication terminal 10) that requested the login as a destination candidate, and Can communicate the operating status. As a result, the destination candidates (such as the communication terminal 70) can also display the destination candidate status as shown in FIG. 13 (step S78).

Next, a process for preparing for image / sound communication using the communication system will be described with reference to FIGS. 15 and 16. FIG. 15 is a sequence diagram illustrating processing for preparing for image / sound communication using the communication system. FIG. 16 is a sequence diagram illustrating a data ID transmission process. For convenience of explanation, a case will be described in which the communication terminal 10 makes a request to start communication with the communication terminal 70. Here, the terminal ID of the communication terminal 10 is “10aa”, and the terminal ID of the communication terminal 70 is “10da”.
When the user a selects a desired destination from the destination list shown in FIG. 14, the receiving unit 12 receives the selection, and the transmission / reception unit 11 sends a communication start request information to the communication management system 50. Send. Specifically, the transmission / reception unit 11 transmits communication start request information to the communication management system 50 via the communication network 2 (step S121). This start request information includes the terminal ID “01aa” of the request source terminal (communication terminal 10) and the terminal ID “01da” of the destination terminal (communication terminal 70). Thereby, the transmission / reception unit 51 of the communication management system 50 receives the communication start request information.

  Next, the storage / reading processing unit 59 of the communication management system 50 includes the terminal ID “01aa” of the request source terminal (communication terminal 10) and the terminal ID “01da” of the destination terminal (communication terminal 70) included in the start request information. Based on the above, in the terminal management table (see FIG. 10), both the field portions of the operating state of the records each including the terminal ID “01aa” and the terminal ID “01da” are changed to “busy” (step S122). ). In this state, the request source terminal (communication terminal 10) and the destination terminal (communication terminal 70) have not started a video conference but are in a communication state, and other communication terminals are requested by the request source terminal (communication terminal). 10) When a communication with a destination terminal (communication terminal 70) is started, a notification sound or display indicating a so-called communication state is output.

  Next, the storage / reading processing unit 59 of the communication management system 50 uses the terminal IDs of the request source terminal (communication terminal 10) and the destination terminal (communication terminal 70) received by the process of step S121 as search keys. Each corresponding IP address is read by searching the terminal management table (see FIG. 10) (step S123).

  Then, the transmission / reception unit 51 of the communication management system 50 transmits communication start request information to the IP address of the destination terminal (communication terminal 70) read in step S123 (step S124). The start request information includes the terminal IDs “01aa” and “01da” received by the process of step S121. Thereby, the transmission / reception unit 71 of the destination terminal (communication terminal 70) receives the start request information.

  In response to this, the transmission / reception unit 71 of the destination terminal (communication terminal 70) transmits response availability information indicating the availability of response to the communication management system 50 (step S125). Thereby, the transmission / reception unit 51 of the communication management system 50 receives the response availability information. The response availability information indicates that communication is possible or impossible, but here, a case where communication is possible will be described.

  The transmission / reception unit 51 of the communication management system 50 transmits relay start request information indicating a relay start request to the relay device 30 (step 126). This relay start request information includes each IP address read out by the process of step S123. Thereby, the transmission / reception unit 31 of the relay device 30 receives the relay start request information.

  Further, the transmission / reception unit 51 of the communication management system 50 transmits the response availability information received in step S125 to the request source terminal (communication terminal 10) (step S127). Thereby, the transmission / reception unit 11 of the request source terminal (communication terminal 10) receives the response availability information (here, communication is possible).

  As described above, the image / sound communication session is established between the request source terminal (communication terminal 10), the relay device 30, and the destination terminal (communication terminal 70) (steps S128-1 and S128). As shown in FIG. 6, the request source terminal (communication terminal 10) establishes an image / sound communication session with each of the communication terminals 90b and 90c.

  Next, as illustrated in FIG. 16, the generation unit 33 of the relay device 30 generates a unique data ID for each of the communication terminals 10, 70, 90 b, and 90 c that perform communication within the same communication session ( Step S141). Each data ID is used later when each communication terminal transmits the image data and the sound data together with the image data and the sound data, so that another communication terminal receiving the data ID specifies the transmission source of the image data and the sound data.

  Next, the storage / reading processing unit 39, for the data management table (see FIG. 8), the data ID of each communication terminal generated by the generation unit 33 and the IP of each communication terminal received in step S126. The address is managed in association with each communication terminal (step S142).

  Next, the transmission / reception unit 31 transmits all sets of the data ID and the IP address associated in step S142 to the communication management system 50 (step S143). As a result, the transmission / reception unit 51 of the communication management system 50 receives all sets of data IDs and IP addresses.

  Next, in the communication management system 50, the storage / read processing unit 59 searches the terminal management table (see FIG. 10) using each IP address received in step S143 as a search key, thereby corresponding terminal ID and destination. The name is read (step S144). And the transmission / reception part 51 transmits all the combinations of data ID, terminal ID, and a destination name with respect to the communication terminal 10 (step S145-1). Thereby, the transmission / reception unit 11 of the communication terminal 10 receives all sets of the data ID, the terminal ID, and the destination name. Similarly, the transmission / reception unit 51 transmits all sets of data ID, terminal ID, and destination name to the communication terminal 70 (step S145-2). Thereby, the transmission / reception unit 71 of the communication terminal 70 receives all sets of the data ID, the terminal ID, and the destination name.

  Subsequently, using FIG. 17 and FIG. 18, when the user a of the communication terminal 10 conducts a video conference in the same communication session as the other three communication terminals 70, 90 b, 90 c, the same as the user b. The case of becoming a group will be described. FIG. 17 is a diagram illustrating a screen example of the communication terminal. FIG. 18 is a sequence diagram illustrating a process for creating a new group.

  First, as shown in FIG. 17A, the communication terminals 10, 70, 90b, and 90c used by the users a, b, c, and d are all communicating within the same communication session. Yes, and all are free (unaffiliated). In FIG. 17A, an image (user a) captured by the own terminal (communication terminal 10) is greatly displayed on the left side, and an affiliation name display area N1 indicating the affiliation of the communication terminal 10 is displayed on the upper part. Has been. In addition, on the right side, images (user b, user c, user d) captured by other communication terminals are displayed in a small size, and in the upper part, an affiliation name display area indicating the affiliation of each other communication terminal N2 is displayed. Here, it is shown that all the communication terminals are in a free state. In addition, each destination name is displayed in the lower part of each user's image, and the user a can grasp from which other communication terminal the image is.

  In the affiliation name display area N2, a [Mute] button, a [+] button, and a [-] button are displayed. The [Mute] button is a button for muting the sound from the communication terminal belonging to the affiliation name display area N2. The [+] button is a button for increasing the volume of the sound from the communication terminal belonging to the affiliation name display area N2. The [-] button is a button for lowering the volume of the sound from the communication terminal belonging to the affiliation name display area N2.

  Further, a “broadcast” button is displayed in the lower center of the screen, and an “exit” button is displayed on the lower right side. The “broadcast” button is a button for preferentially outputting the image and sound of the own terminal to communication terminals belonging to any group within the same communication session. The “leave” button is a button for leaving the group to which the terminal belongs. However, it remains as it is in the free state.

  In FIG. 17A, a large display area in which the user a is displayed and a small display area in which the users b, c, and d are displayed are shown, but the present invention is not limited to this. . For example, all users a, b, c, and d may be displayed as free in the same large display area, or all users b, c, and d may be displayed as free in the same small display area. Also good.

  In the state of FIG. 17 (a), when user a newly belongs to the same group G1 as user b, when the display area of free user b is selected, reception is performed as shown in FIG. The unit 12 accepts the selection (step S201). Then, the transmission / reception unit 11 transmits group creation request information for requesting group creation to the communication management system 50 (step S202). This request information includes the terminal ID “01aa” of the request source terminal (communication terminal 10) that makes the group creation request and the terminal ID “01ba” of the request destination terminal (communication terminal 90b) included in the group. . Thereby, the transmission / reception unit 51 of the communication management system 50 receives the group creation request information.

  Next, the creating unit 53 creates a unique affiliation ID for identifying a new group (step S203). Then, the storage / reading processing unit 59 creates the terminal ID of the request source terminal (communication terminal 10) and the terminal ID of the request destination terminal (communication terminal 90b) in step S203 in the affiliation management table (see FIG. 12). The assigned affiliation ID is associated and managed (step S204). And the transmission / reception part 51 transmits the update information which shows the content updated by step 204 to each communication terminal 10,70,90b, 90c (step S205-1,2,3,4). Thereby, each communication terminal 10, 70, 90b, 90c receives update information, respectively. Since the update information includes information indicating the newly created affiliation ID and the terminal ID associated with the newly created affiliation ID, each communication terminal 10, 70, 90b, 90c is newly created. The communication terminals belonging to the selected group can be identified.

  Next, the display control units 14, 74, 94b, and 94c of the communication terminals 10, 70, 90b, and 90c change the screen layout, and the communication control units 13, 73, 93b, and 93c Adjustment is performed (steps S206-1, 2, 3, 4).

  For example, in the case of the communication terminal 10, when the terminal ID associated with the received affiliation ID is the terminal ID of the own terminal, the display control unit 14 displays the left side shown in FIG. The affiliation name in the affiliation name display area N1 is updated based on the affiliation ID to which the own terminal belongs. Furthermore, the display control unit 14 displays the image of the other communication terminal associated with the affiliation ID to which the own terminal belongs together with the image of the own terminal, as shown in FIG. It is displayed in association with the display area N1. The display control unit 14 converts the image data of other communication terminals belonging to the new group (affiliation ID) to the data ID corresponding to the terminal ID of the other communication terminal associated with the received belonging ID to which the own terminal belongs. Identify based on. The image layout associated with the affiliation name display area N1 to which the own terminal belongs is set to have a larger image size assigned to each communication terminal than the image layout associated with the affiliation name display area N2 to which the own terminal does not belong. When none of the terminal IDs associated with the received affiliation ID is the terminal ID of the own terminal, the display control unit 14 affiliates the affiliation name display area N2 on the right side shown in FIG. The name is updated based on the received affiliation ID to which the terminal does not belong. Further, the display control unit 14 displays an image of another communication terminal associated with the received affiliation ID to which the own terminal does not belong in association with the affiliation name display area N2 on the right side. As a result, as shown in FIG. 17B, the affiliation name and image layout of the affiliation name display area N2 are changed.

  Further, the communication control unit 13 of the communication terminal 10 determines the volume of the sound data of each communication terminal specified by the data ID received from the communication management system 50 based on the terminal ID associated with the received affiliation ID. Make adjustments. The volume is set in advance so that the volume of the communication terminal associated with the affiliation name display area N1 to which the own terminal belongs is larger than the volume of the communication terminal associated with the affiliation name display area N2 to which the own terminal does not belong. Yes. Therefore, with the creation of the group, the communication control unit 13 performs control so that the volume of the sound data of the communication terminal newly belonging to the group of the belonging name display area N1 is increased. The sound data for increasing the volume can be specified based on the data ID associated with the terminal ID. If the volume is already set according to the sound data of the target communication terminal before the update information is received, the volume adjustment is not necessary.

  On the other hand, when there is a communication terminal that does not belong to the group to which the own terminal belongs among the communication terminals that belong to the group of the belonging name display area N2 of the communication terminal 10, the display control unit 14 displays the sound of the communication terminal 10. Control the volume by data to be low. If the volume based on the sound data of the target communication terminal is already set to be low before the update information is received, the volume adjustment is not necessary. Note that the volume of the communication terminals belonging to the group of the affiliation name display area N2 may be set so that the mute or the volume is zero.

  Thereby, in the communication terminal 10, as shown in FIG.17 (b), the image of the own terminal (user a) and the image of the user b are displayed as a new group G1. FIG. 17B shows a state in which the users c and d belong to the same group G2. In the communication terminal 10, the communication control unit 13 increases the volume of the sound from the communication terminal 90b that belongs to the same group G1. The volume of the sound from the communication terminals 90c and 70 belonging to the different group G2 remains low. That is, the size of the image from the communication terminal belonging to the same group is increased, and the sound volume is adjusted to be increased.

  Subsequently, a process for changing a group will be described with reference to FIGS. 19 and 20. FIG. 19 is a diagram illustrating a screen example of the communication terminal. FIG. 20 is a sequence diagram showing processing for changing a group.

  FIG. 19A is the same screen as FIG. In this state, when the user of the communication terminal a next selects the display area of the user c or the user d in order to change the affiliation to the group G2, as shown in FIG. The accepting unit 12 accepts selection (step S221). And the transmission / reception part 11 transmits the change request information for requesting a change of affiliation to the communication management system 50 (step S222). The request information includes the terminal ID “01aa” of the request source terminal (communication terminal 10) that makes the change request, and the request destination terminal (terminal ID “01ca” of the communication terminal 90c or the request destination terminal) included in the change destination group. The terminal ID “01da” of the (communication terminal 90d) is included, whereby the transmission / reception unit 51 of the communication management system 50 receives the change request information, as the request destination terminals of the communication terminals 90c and 70. Both terminal IDs may be included.

  Next, the storage / reading processing unit 59 uses the affiliation ID associated with the terminal ID of the request source terminal (communication terminal 10) in the affiliation management table (see FIG. 12) to request the requested terminals (communication terminals 90c and 90d). ) Is changed to the same affiliation ID as the affiliation ID associated with (). And the transmission / reception part 51 transmits the update information which shows the content updated by step 223 to each communication terminal 10, 70, 90b, 90c (step S224-1, 2, 3, 4). Thereby, each communication terminal 10, 70, 90b, 90c receives update information, respectively. The display control units 14, 74, 94b, and 94c of the communication terminals 10, 70, 90b, and 90c change the screen layout, and the communication control units 13, 73, 93b, and 93c adjust the volume. (Step S225-1, 2, 3, 4). Thereby, in the communication terminal 10, as shown in FIG.19 (b), the image of the user a and the image of the users c and d are displayed as the new group G2. In FIG. 19B, the user b remains in the group G1, but may be in a free state.

  Next, a process for leaving a group will be described with reference to FIGS. 21 and 22. FIG. 21 is a diagram illustrating a screen example of the communication terminal. FIG. 22 is a sequence diagram showing processing for leaving a group.

  FIG. 21A is the same screen as FIG. In this state, when the user of the communication terminal “a” selects the “exit” button at the lower right of the screen this time to exit from the group G2, the reception unit 12 selects as shown in FIG. Is received (step S241). Then, the transmission / reception unit 11 transmits free request information for requesting a free (non-affiliation) state to the communication management system 50 (step S222). This request information includes the terminal ID “01aa” of the request source terminal (communication terminal 10) making the free request. Thereby, the transmission / reception unit 51 of the communication management system 50 receives the free request information.

  Next, the storage / reading processing unit 59 changes the affiliation ID associated with the terminal ID of the request source terminal (communication terminal 10) to the affiliation ID indicating free in the affiliation management table (see FIG. 12) ( Step S243). And the transmission / reception part 51 transmits the update information which shows the content updated by step 243 to each communication terminal 10, 70, 90b, 90c (step S244-1, 2, 3, 4). Thereby, each communication terminal 10, 70, 90b, 90c receives update information, respectively. The display control units 14, 74, 94b, and 94c of the communication terminals 10, 70, 90b, and 90c change the screen layout, and the communication control units 13, 73, 93b, and 93c adjust the volume. (Step S245-1, 2, 3, 4). Thereby, in the communication terminal 10, as shown in FIG.21 (b), the own terminal (communication terminal 10) becomes a screen layout which belonged freely. In FIG. 21B, the user b remains in the group G1, but may be in a free state. The screen layout and volume adjustment can be realized by the same processing as the processing in steps S206-1, 2, 3, and 4.

  Next, the broadcast process will be described with reference to FIGS. FIG. 23 is a diagram illustrating a screen example of the communication terminal. FIG. 24 is a sequence diagram showing a broadcast process.

  FIG. 23A is the same screen as FIG. In this state, in order for the user of the communication terminal a to preferentially transmit the image data and sound data of the own terminal (communication terminal 10) to all communication terminals in the same communication session, When the “broadcast” button at the lower right is selected, the reception unit 12 receives the selection as shown in FIG. 24 (step S261). Then, the transmission / reception unit 11 transmits broadcast start request information for requesting the start of broadcast to the communication management system 50 (step S262). This request information includes the terminal ID “01aa” of the request source terminal (communication terminal 10) that makes the broadcast request. Thereby, the transmission / reception unit 51 of the communication management system 50 receives the broadcast request information.

  Next, the storage / reading processing unit 59 changes the affiliation ID associated with the terminal ID of the request source terminal (communication terminal 10) to the affiliation ID indicating broadcast in the affiliation management table (see FIG. 12) ( Step S263). And the transmission / reception part 51 transmits the update information which shows the content updated by step 263 to each communication terminal 10, 70, 90b, 90c (step S264-1, 2, 3, 4). Thereby, each communication terminal 10, 70, 90b, 90c receives update information, respectively. The display control units 14, 74, 94b, and 94c of the communication terminals 10, 70, 90b, and 90c change the screen layout, and the communication control units 13, 73, 93b, and 93c adjust the volume. (Step S245-1, 2, 3, 4).

  Thereby, in all the communication terminals 10, 70, 90b, and 90c in the same communication session, as shown in FIG.23 (b), it becomes a screen layout in which the image of the communication terminal 10 is displayed preferentially. . When the user “a” selects the “broadcast” button again, the broadcast state is canceled and the screen layout shown in FIG.

  Note that the screen layout and volume adjustment can be realized by the same processing as that described in steps S206-1, 2, 3, and 4. However, when the received affiliation ID indicates broadcast, the display control unit 14 affiliates that indicate broadcast regardless of whether or not the terminal ID associated with the received affiliation ID includes the own terminal. The layout is changed so that only the image of the communication terminal associated with the ID is displayed on the screen. Furthermore, the communication control unit 13 adjusts the sound data of only the communication terminal associated with the affiliation ID indicating the broadcast so that the volume is higher than the sound data of the other communication terminals. Note that the communication control unit 13 may set the sound data of the other communication terminal to be muted or set to 0, and control the sound data of the other communication terminal not to be output from the speaker 115.

  In the above example, as shown in FIG. 17A, an image from another communication terminal in the same group as the own terminal is displayed in a large size, and an image from another group is displayed in a small size. It is not limited to. For example, if the screen size is small, such as a smartphone, only images from other communication terminals in the same group as the own terminal are displayed, and images from other groups of communication terminals are displayed. A “display switching” button may be displayed.

<< Main effects of this embodiment >>
As described above, according to the present invention, in the same communication session, the image of the other party actively making a call or the like is displayed relatively large, and the image of the other party actively making a call or the like is displayed relatively small. At the same time, if the user wants to actively talk with the other party displayed in a small size, the user can actively talk by switching the screen layout. By doing in this way, even if it is another group, there exists an effect that a telephone call etc. can be performed rapidly.

<< Supplement of Embodiment >>
In the above-described embodiment, identification information is provided and acquired by short-range wireless communication. However, the present invention is not limited to this. For example, the provision and acquisition processing may be performed by priority communication using a USB cable or the like.
As an example of the communication terminal, the case of a video conference terminal has been described. However, the present invention is not limited to this, and a telephone system such as an IP (Internet Protocol) telephone or an Internet telephone may be used. In addition, smartphones, smart watches, mobile phones, car navigation terminals, wearable computers, surveillance cameras, digital cameras that can communicate with WiFi, devices with communication functions (projectors, game consoles, etc.), digital signage, or communication It may be an industrial device having a function. The wearable computer includes a wristwatch, a head mounted display, and the like. Industrial equipment includes office equipment such as an MFP (Multifunction Peripheral / Printer / Product), medical equipment such as an endoscope and CT scan, and agricultural equipment such as a cultivator.

  In the above embodiment, image data and sound data have been described as an example of content data. However, the present invention is not limited to this, and touch data may be used. In this case, the feeling that the user touched on one terminal side is transmitted to the other terminal side. Further, the content data may be smell data. In this case, the odor (odor) on one terminal side is transmitted to the other terminal side. The content data may be at least one of image data, sound data, tactile data, and olfactory data.

  Moreover, although the case where the video conference was performed by the communication system 1 was demonstrated in the said embodiment, it is not restricted to this, General conversations, such as a meeting, between families and friends, or the information of one direction It may be used for presentation.

  Moreover, although the said embodiment demonstrated the example of near field communication, such as NFC, about a memory | storage request | requirement and a read-out request | requirement, you may use ultrasonic communication.

  Furthermore, each function of the embodiment described above can be realized by one or a plurality of processing circuits. Here, the processing circuit may be a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, or an ASIC (Application Specific Integrated Circuit) designed to execute each function described above. ), DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array), and conventional circuit modules.

DESCRIPTION OF SYMBOLS 1 Communication system 2 Communication network 3 Communication network 10 Communication terminal (an example of a 1st communication terminal)
DESCRIPTION OF SYMBOLS 11 Transmission / reception part 15 Judgment part 16 Selection part 17 Starting part 18 Acquisition and provision part 30 Relay apparatus 50 Communication management system 51 Transmission / reception part (an example of a reception means, an example of a transmission means)
53 Creation unit (an example of creation means)
70 communication terminal (an example of another communication terminal, an example of a second communication terminal)
71 Transmission / Reception Unit 75 Judgment Unit 76 Selection Unit 77 Activation Unit 78 Acquisition / Provision Unit 90b Communication Terminal (Example of Second Communication Terminal)
90b communication terminal (example of second communication terminal)
5000 storage unit 5001 authentication management DB
5002 Terminal management DB
5003 Destination list management DB
5004 Affiliation management DB (an example of affiliation management means)

JP 2012-178135 A

Claims (8)

A communication management system for managing communication between first and second communication terminals,
First identification information for identifying the first communication terminal and the second communication terminal communicating in the same communication session as the first communication terminal are identified from the first communication terminal. Receiving means for receiving second identification information for
Affiliation management means for managing the received first and second identification information in association with predetermined affiliation identification information for identifying a predetermined group;
Transmitting means for transmitting the associated first and second identification information and the predetermined affiliation identification information to the first and second communication terminals;
A communication management system comprising: The receiving means receives from the first communication terminal group creation request information indicating a request to create the group for causing the second communication terminal to belong to the same group as the first communication terminal;
Based on the reception of the group creation request information, having a creation means for creating the predetermined affiliation identification information,
The predetermined management unit manages the first and second identification information received by the reception unit in association with the predetermined affiliation identification information created by the creation unit. The communication management system described. The receiving means receives first identification information for identifying the first communication terminal from the first communication terminal, and the first communication terminal belongs to the first communication terminal. Receiving change request information indicating a request for changing from the predetermined group to another group to which the second communication terminal belongs;
The affiliation management means is configured to change and manage the predetermined affiliation identification information associated with the first identification information to other affiliation identification information for identifying the other group. The communication management system according to claim 1 or 2. The receiving means receives, from the first communication terminal, first identification information for identifying the first communication terminal, and requests for making the first communication terminal unaffiliated. Receiving the unaffiliated request information shown,
The affiliation management means changes the predetermined affiliation identification information associated with the first identification information to non-affiliation identification information for identifying the affiliation and manages the affiliation management means. 4. The communication management system according to any one of 3. The receiving means receives first identification information for identifying the first communication terminal from the first communication terminal, and transmits content data transmitted from the first communication terminal to other communication. Receiving priority playback request information indicating a request for playback with priority over other content data transmitted from the terminal;
The affiliation management unit manages the affiliation management unit in association with non-affiliation information indicating a state not belonging to any group from the predetermined affiliation identification information associated with the first identification information. 4. The communication management system according to any one of 3. A communication management system according to any one of claims 1 to 5;
The first communication terminal;
The second communication terminal;
A communication system comprising: A communication management method executed by a communication management system that manages communication of first and second communication terminals,
The communication management system includes:
First identification information for identifying the first communication terminal and the second communication terminal communicating in the same communication session as the first communication terminal are identified from the first communication terminal. A receiving step for receiving second identification information for:
An affiliation management step of managing the received first and second identification information in association management means in association with predetermined affiliation identification information for identifying a predetermined group;
A transmitting step of transmitting the associated first and second identification information and the predetermined affiliation identification information to the first and second communication terminals;
A communication management method comprising: executing the communication management method.   A program that causes a computer to execute the steps according to claim 7.

Images