JP2017076951A - Management system, transmission terminal, transmission management method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform transmission of content data to a first terminal while performing transmission of content data to a second terminal different from the first terminal.SOLUTION: A management system comprises: a receiving part that receives a request for establishing a first session between a first terminal and a second terminal, the request transmitted from the first terminal; and a session control part that, when the receiving part receives the request to establish the first session while a second session different from the first session is established between the first terminal and a third terminal, transmits the request to establish the first session to the second terminal.SELECTED DRAWING: Figure 14

Description

  The present invention relates to a management system, a transmission terminal, a transmission management method, and a program.

  In recent years, distribution systems that distribute content data such as video from a live relay camera installed at a distribution source to a plurality of terminals via a communication network such as the Internet are known. For example, video and audio of a nursery school or kindergarten are distributed to the guardian's terminal. As a result, the guardian can check the state of the child in the park, which is advantageous in strengthening the security in the park and relieving the guardian's anxiety.

  Patent Document 1 discloses a technique for establishing a new session and exchanging data in order to add and exchange data not supported by a service with a communication partner.

  However, conventional conference systems and distribution systems have a problem that content data cannot be transmitted to a partner other than the partner during distribution of the content data to the partner.

  Accordingly, it is an object to provide a technique capable of transmitting content data to a second terminal different from the first terminal while transmitting content data to the first terminal.

  In the management system, a receiving unit that receives a request that is a request for establishing a first session between a first terminal and a second terminal and that is transmitted by the first terminal, the first terminal, When the receiving unit receives a request to establish the first session when a second session different from the first session is established with the third terminal, the second session A session control unit that transmits a request for establishing the first session to the terminal.

  According to the disclosed technology, it is possible to transmit content data to a second terminal different from the first terminal while transmitting the content data to the first terminal.

1 is a schematic diagram of a transmission system according to an embodiment of the present invention. It is an external view of the terminal which concerns on this embodiment. It is a hardware block diagram of the terminal which concerns on one Embodiment of this invention. It is a hardware block diagram of the management system, relay apparatus, program provision system, or maintenance system which concerns on one Embodiment of this invention. It is a functional block diagram of each terminal, apparatus, and system which comprise the transmission system which concerns on 1st Embodiment. It is a conceptual diagram which shows a relay apparatus management table. It is a conceptual diagram which shows a terminal authentication management table. It is a conceptual diagram which shows a terminal management table. It is a conceptual diagram which shows a destination list management table. It is a conceptual diagram which shows a session management table. It is a conceptual diagram which shows a relay apparatus selection management table. It is a conceptual diagram which shows an entrance management table. It is a conceptual diagram which shows a meeting room management table. It is a sequence diagram of the transmission system in the case of performing a telephone call during distribution. It is a flowchart of the process at the time of the terminal of a delivery origin making a telephone call during delivery. It is a flowchart of a session management process. It is a flowchart of an incoming call process of a destination terminal. It is a figure which shows the example of the screen display of the terminal of a delivery origin. It is a figure which shows the example of the screen display of the terminal of a delivery destination. It is the conceptual diagram which showed the transmission / reception state of the image data in the transmission system, audio | voice data, and various management information. It is a figure which shows the meeting room new creation image displayed when creating a meeting room newly. It is the sequence diagram which showed the process at the time of newly creating a meeting room. It is a figure which shows the meeting room detailed image which shows the detailed information of a meeting room. It is a figure which shows the meeting room edit image displayed when editing meeting room information. It is the sequence diagram which showed the process at the time of the display of a meeting room list, and the editing of a meeting room. It is the sequence diagram which showed the process at the time of entering a meeting room from a meeting room list. It is a flowchart which shows the process according to the result of entrance determination. It is a figure which shows the image containing destination terminal state list information. It is the sequence diagram which showed the process which displays the image containing destination terminal state list information on a terminal. It is the sequence diagram which showed the process which requests | requires the start of a telephone call. It is the sequence figure which showed the process in the case of permitting the request | requirement of a telephone call start. It is the sequence diagram which showed the process in the case of refusing the request | requirement of a communication start. It is the sequence diagram which showed the process which requests | requires relay of call data. It is the sequence diagram which showed the process which requests | requires withdrawal from the session for telephone call data. It is a functional block diagram of each terminal, apparatus, and system which comprise the transmission system which concerns on 2nd Embodiment. It is a conceptual diagram which shows a quality setting management table. It is a sequence diagram which shows an example of the process at the time of performing a communication band control process. It is a flowchart which shows an example of a zone | band information acquisition process. It is a flowchart which shows an example of a quality determination process. It is an example of a display screen at the distribution destination when the communication band for video distribution is a predetermined threshold value or less.

[First Embodiment]
<< Overall Configuration of Embodiment >>
Hereinafter, a first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a schematic diagram of a transmission system 1 according to an embodiment of the present invention. First, the outline of the present embodiment will be described with reference to FIG.

  In the transmission system, a data providing system that transmits content data in one direction from one terminal to the other terminal via the management system, and information, emotions, and the like are mutually transmitted between a plurality of terminals via the management system. Communication system is included. This communication system is a system for mutually transmitting information, emotions, etc. between a plurality of communication terminals (corresponding to “terminals”) via a communication management system (corresponding to “management system”). Examples thereof include a video phone system, a voice conference system, a voice phone system, and a PC (Personal Computer) screen sharing system.

  1 includes a plurality of terminals (10aa, 10ab,...), A display (120aa, 120ab,...) For each terminal (10aa, 10ab,...), And a plurality of relay devices (30a, 30b, 30c). 30d, 30e), the management system 50, the program providing system 90, and the maintenance system 100.

  In the present embodiment, when an arbitrary terminal is indicated among terminals (10aa, 10ab,...), It is simply referred to as “terminal 10”. When an arbitrary display is shown among the displays (120aa, 120ab,...), It is simply referred to as “display 120”. When any relay device (30a, 30b, 30c, 30d, 30e) is shown, it is simply referred to as “relay device 30”.

  The terminal 10 transmits and receives image data and audio data as an example of content data. That is, the call in the present embodiment includes not only audio data transmission / reception but also image data transmission / reception. That is, the terminal 10 in the present embodiment transmits and receives image data and audio data. However, the terminal 10 may transmit and receive audio data without transmitting and receiving image data. The terminal 10 may be, for example, a terminal such as a smartphone or a laptop computer. In that case, the terminal 10 may be configured to be connected to the management system 50 or the like via a transmission network such as a mobile phone network, a wireless LAN, or the Internet.

  In the present embodiment, the case where the image of the image data is a moving image will be described, but it may be a still image as well as a moving image. The image of the image data may include both a moving image and a still image.

  The relay device 30 relays image data and audio data between the plurality of terminals 10. The management system 50 manages communication of a plurality of terminals 10 that transmit and receive content data. Information related to communication of the terminal 10 includes information related to the terminal 10, information related to the relay device 30 that relays communication between the plurality of terminals 10, and information related to communication settings using the terminal 10 and the relay device 30. It is. More specifically, the management system 50 stores the operation status of the relay device 30 and information for each relay device 30 such as an IP address, information for determining the relay device 30 used by the terminal 10, and the like. . In addition, the management system 50 includes authentication information (terminal ID and password) for the terminal 10 to log in to the transmission system 1, information on a terminal that is a destination of communication registered for each terminal 10, and the terminal 10 and the relay device Information related to communication (session) using 30 is stored. Further, the management system 50 stores information related to communication settings in which one or more designated terminals 10 can participate. Details of the information stored in the management system 50 will be described later.

  Further, the plurality of routers (70a, 70b, 70c, 70d, 70ab, 70cd) shown in FIG. 1 perform selection of optimal paths for image data and audio data. In the present embodiment, “router 70” is used to indicate an arbitrary router among the routers (70a, 70b, 70c, 70d, 70ab, 70cd).

  The program providing system 90 includes an HD (Hard Disk) (not shown) that stores a terminal program for realizing various functions or various means in the terminal 10, and transmits the terminal program to the terminal 10. be able to. The HD of the program providing system 90 also stores a relay device program for causing the relay device 30 to realize various functions or various means, and can transmit the relay device program to the relay device 30. . Further, the HD of the program providing system 90 also stores a transmission management program for causing the management system 50 to realize various functions or various means, and can transmit the transmission management program to the management system 50. .

  The maintenance system 100 is a computer for performing maintenance, management, or maintenance of at least one of the terminal 10, the relay device 30, the management system 50, and the program providing system 90. For example, when the maintenance system 100 is installed in the country and the terminal 10, the relay device 30, the management system 50, or the program providing system 90 is installed outside the country, the maintenance system 100 is remotely connected via the communication network 2. Maintenance such as maintenance, management, and maintenance of at least one of the terminal 10, the relay device 30, the management system 50, and the program providing system 90 is performed. In addition, the maintenance system 100 does not go through the communication network 2, but includes a model number, a manufacturing number, a sales destination, a maintenance check, at least one of the terminal 10, the relay device 30, the management system 50, and the program providing system 90 Or, maintenance such as failure history management is performed.

  Further, the terminals (10aa, 10ab, 10ac, 10a...), The relay device 30a, and the router 70a are communicably connected via the LAN 2a. The terminals (10ba, 10bb, 10bc, 10b...), The relay device 30b, and the router 70b are communicably connected via the LAN 2b. The LAN 2a and the LAN 2b are communicably connected by a dedicated line 2ab including a router 70ab, and are constructed in a predetermined area A.

  On the other hand, the terminals (10ca, 10cb, 10cc, 10c...), The relay device 30c, and the router 70c are communicably connected via the LAN 2c. The terminals (10da, 10db, 10dc, 10d...), The relay device 30d, and the router 70d are communicably connected via a LAN 2d. The LAN 2c and the LAN 2d are communicably connected via a dedicated line 2cd including the router 70cd, and are constructed in a predetermined area B.

  The terminals (10e1, 10e2,...) Are communicably connected via the Internet 2i.

  In addition, the management system 50 and the program providing system 90 are communicably connected to the terminal 10 and the relay device 30 via the Internet 2i. The management system 50 and the program providing system 90 may be installed in the region A or the region B, or may be installed in a region other than these.

  The relay device 30e is connected to all the terminals 10 of the transmission system 1 via the communication network 2 so as to be communicable. This relay device 30e is always in operation, and is installed in a region other than these in order to be less affected by the traffic in the local area of region A or region B. Thereby, when the terminal 10 makes a call with a terminal installed in another local area, the relay device 30e is used as a relay device for relaying the call data. Further, when a call is made between terminals in the same local area, the relay device 30e is used as an emergency relay device even if the relay device installed in the local area is not operating.

  In the present embodiment, the communication network 2 of the present embodiment is constructed by the LAN 2a, the LAN 2b, the dedicated line 2ab, the Internet 2i, the dedicated line 2cd, the LAN 2c, and the LAN 2d. This communication network 2 may have a place where not only wired communication but also wireless communication is performed.

  In FIG. 1, the four sets of numbers shown under each terminal 10, each relay device 30, management system 50, each router 70, program providing system 90, and maintenance system 100 are in general IPv4. An IP address is simply shown. For example, the IP address of the terminal 10aa is “1.2.1.3”. In addition, IPv6 may be used instead of IPv4, but IPv4 will be used for the sake of simplicity.

<< Hardware Configuration of Embodiment >>
Next, the hardware configuration of this embodiment will be described.

  FIG. 2 is an external view of the terminal 10 according to the present embodiment. Hereinafter, the longitudinal direction of the terminal 10 will be described as the X-axis direction, the direction orthogonal to the X-axis direction in the horizontal plane as the Y-axis direction, and the direction orthogonal to the X-axis direction and the Y-axis direction (vertical direction) will be described as the Z-axis direction.

  As shown in FIG. 2, the terminal 10 includes a housing 1101, an arm 1200, and a camera housing 1300. Among these, the front wall surface 1110 of the housing 1101 is provided with an air intake surface (not shown) formed by a plurality of air intake holes, and the plurality of exhaust holes are formed on the rear wall surface 1120 of the housing 1101. An exhaust surface 1121 is provided. Thus, by driving a cooling fan built in the housing 1101, the outside air behind the terminal 10 can be taken in through an intake surface (not shown) and exhausted to the rear of the terminal 10 through an exhaust surface 1121. A sound collecting hole 1131 is formed in the right side wall surface 1130 of the housing 1101, and sounds such as voice, sound, and noise can be collected by a built-in microphone 114 a described later.

  An operation panel 1150 is formed on the right side wall surface 1130 side of the housing 1101. The operation panel 1150 is provided with a plurality of operation buttons (108a to 108e) to be described later, a power switch 109 to be described later, and an alarm lamp 119 to be described later, and outputs sound from a built-in speaker 115a to be described later. A sound output surface 1151 formed by a plurality of sound output holes for passing through is formed. In addition, a housing portion 1160 as a recess for housing the arm 1200 and the camera housing 1300 is formed on the left wall surface 1140 side of the housing 1101. The right side wall surface 1130 of the housing 1101 is provided with a plurality of connection ports (1132a to 1132c) for electrically connecting cables to an external device connection I / F 118 described later. On the other hand, the left wall surface 1140 of the housing 1101 is provided with a connection port (not shown) for electrically connecting the cable 120c for the display 120 to an external device connection I / F 118 described later.

  In the following description, “operation button 108” is used when an arbitrary operation button is indicated among the operation buttons (108a to 108e), and “an arbitrary connection port is indicated among the connection ports (1132a to 1132c)”. This will be described using the connection port 1132 ”.

  Next, the arm 1200 is attached to the housing 1101 via the torque hinge 1210, and the arm 1200 is configured to be able to rotate in the vertical direction with respect to the housing 1101 within a tilt angle θ1 of 135 degrees. ing. FIG. 2 shows a state where the tilt angle θ1 is 90 degrees.

  The camera housing 1300 is provided with a built-in camera 112a, which will be described later, and can capture images of users, documents, rooms, and the like. A torque hinge 1310 is formed in the camera housing 1300. The camera housing 1300 is attached to the arm 1200 via a torque hinge 1310. The camera housing 1300 is attached to the arm 1200 via a torque hinge 1310. The pan angle θ2 of ± 180 degrees is assumed with respect to the arm 1200, with the state shown in FIG. And a tilt angle θ3 of ± 45 degrees can be rotated in the vertical and horizontal directions.

  In the case of a terminal 10 that connects a plurality of sessions in parallel, which will be described later, an external camera 112b, an external microphone 114b, an external speaker 115b, and the like are connected using a USB or the like.

  Note that the relay device 30, the management system 50, the program providing system 90, and the maintenance system 100 have the same external appearance as a general server computer, and thus the description of the external appearance is omitted.

  FIG. 3 is a hardware configuration diagram of the terminal 10 according to an embodiment of the present invention. As shown in FIG. 3, the terminal 10 of the present embodiment includes a CPU (Central Processing Unit) 101 that controls the operation of the entire terminal 10, a ROM (Read Only Memory) 102 that stores a terminal program, and a CPU 101. A RAM (Random Access Memory) 103 used as a work area, a flash memory 104 that stores various data such as image data and audio data, and an SSD (SSD) that controls reading or writing of various data to the flash memory 104 according to the control of the CPU 101 Solid State Drive) 105, a media drive 107 that controls reading or writing (storage) of data to a recording medium 106 such as a flash memory, and a destination of the terminal 10 An operation button 108 that is operated when selecting the terminal, a power switch 109 for switching on / off the power of the terminal 10, and a network I / F (Interface) 111 for data transmission using the communication network 2. It has.

  In addition, the terminal 10 includes a built-in camera 112a that captures an image of a subject under the control of the CPU 101, obtains an image, an image sensor I / F 113 that controls driving of the camera 112a, a built-in speaker 115a that outputs sound, and the CPU 101. FIG. 2 shows an audio input / output I / F 116 that processes input / output of audio signals between the microphone 114a and the speaker 115a according to the control, and a display I / F 117 that transmits image data to the external display 120 according to the control of the CPU 101. FIG. 2 shows an external device connection I / F 118 for connecting various external devices attached to the connection ports 1132a to 1132c, an alarm lamp 119 for notifying various functions of the terminal 10, and the above-described components. Such as address bus and data bus for electrical connection It has a Surain 110.

  The display 120 is a display unit configured by a liquid crystal or an organic EL that displays an image of a subject, an operation icon, and the like. The display 120 is connected to the display I / F 117 by a cable 120c. The cable 120c may be an analog RGB (VGA) signal cable, a component video cable, HDMI (High-Definition Multimedia Interface), or DVI (Digital Video). An interactive signal cable may be used.

  The camera 112a includes a lens and a solid-state imaging device that converts light into electric charges and digitizes a subject image (video). As the solid-state imaging device, a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) is used. Etc. are used.

  External devices such as an external camera 112b, an external microphone 114b, and an external speaker 115b can be connected to the external device connection I / F 118 by a USB (Universal Serial Bus) cable or the like.

  The recording medium 106 is detachable from the terminal 10. Further, as long as it is a non-volatile memory that reads or writes data according to the control of the CPU 101, not only the flash memory 104 but also an EEPROM (Electrically Erasable and Programmable ROM) or the like may be used.

  Further, the terminal program may be recorded in a computer-readable recording medium such as the recording medium 106 and distributed as a file in an installable or executable format.

  FIG. 4 is a hardware configuration diagram of the management system according to the embodiment of the present invention. The management system 50 includes a CPU 201 that controls the overall operation of the management system 50, a ROM 202 that stores a transmission management program, a RAM 203 that is used as a work area of the CPU 201, an HD (Hard Disk) 204 that stores various data, and a control of the CPU 201. , A HDD (Hard Disk Drive) 205 that controls reading or writing of various data with respect to the HD 204, a media drive 207 that controls reading or writing (storage) of data with respect to a recording medium 206 such as a flash memory, a cursor, a menu, a window, Display 208 for displaying various information such as characters or images, network I / F 209 for transmitting data using communication network 2, characters, numerical values, various instructions, etc. A keyboard 211 having a plurality of keys for input, a mouse 212 for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like, a CD-ROM (Compact Disc Read) as an example of a removable recording medium 4) a CD-ROM drive 214 for controlling reading or writing of data to / from the only memory 213, and buses such as an address bus and a data bus for electrically connecting the above components as shown in FIG. Line 210 is provided.

  The transmission management program is a file in an installable or executable format, and may be recorded and distributed on a computer-readable recording medium such as the recording medium 206 or CD-ROM 213. .

  Further, since the relay device 30 has the same hardware configuration as that of the management system 50, the description thereof is omitted. However, the ROM 202 stores a relay device program for controlling the relay device 30. Also in this case, the relay device program is a file in an installable or executable format, and is recorded on a computer-readable recording medium such as the recording medium 206 or CD-ROM 213 for distribution. Good.

  Furthermore, since the program providing system 90 has the same hardware configuration as that of the management system 50, the description thereof is omitted. However, a program providing program for controlling the program providing system 90 is recorded in the ROM 202. Also in this case, the program providing program is a file in an installable or executable format, and may be recorded and distributed on a computer-readable recording medium such as the recording medium 206 or the CD-ROM 213. Good.

  Further, since the maintenance system 100 has the same hardware configuration as that of the management system 50, the description thereof is omitted. However, a maintenance program for controlling the maintenance system 100 is recorded in the ROM 202. Also in this case, the maintenance program is a file in an installable or executable format, and may be recorded and distributed on a computer-readable recording medium such as the recording medium 206 or the CD-ROM 213. .

  As another example of the detachable recording medium, the recording medium is provided by being recorded on a computer-readable recording medium such as a CD-R (Compact Disc Recordable), a DVD (Digital Versatile Disk), or a Blu-ray disc. May be.

<< Functional Configuration of Embodiment >>
Next, the functional configuration of this embodiment will be described. FIG. 5 is a functional block diagram of each terminal, device, and system constituting the transmission system 1 of the first embodiment. In FIG. 5, the terminal 10, the relay device 30, and the management system 50 are connected so that data communication can be performed via the communication network 2. Further, the program providing system 90 and the maintenance system 100 shown in FIG. 1 are omitted in FIG. 5 because they are not directly related to the video conference communication.

<Functional configuration of terminal>
The terminal 10 includes a transmission / reception unit 11, an operation input reception unit 12, a login request unit 13, an imaging unit 14a, an imaging unit 14b, an audio input unit 15a, an audio input unit 15b, an audio output unit 16a, an audio output unit 16b, and a display control unit. 17, a storage / read processing unit 18, a session control unit 19, and a destination list creation unit 20. Each of these units is a function or means realized by any one of the components shown in FIG. 3 operating according to a command from the CPU 101 according to a program stored in the ROM 102. Further, the terminal 10 includes a volatile storage unit 1100 constructed by the RAM 103 shown in FIG. 3 and a nonvolatile storage unit 1000 constructed by the flash memory 104 shown in FIG.

<Functional parts of terminal>
Next, each part of the terminal will be described in detail.

  The transmission / reception unit 11 is realized by the network I / F 111 illustrated in FIG. 3, and transmits / receives various data to / from other terminals, devices, or systems via the communication network 2. The transmission / reception unit 11 starts receiving state information indicating the state of each terminal as a destination candidate from the management system 50 before starting a call with a desired destination terminal. This status information includes not only the operating status of each terminal 10 (the status of ON line or OFF line) but also the detailed status such as whether a call is in progress or waiting even if it is an ON line. Indicates. In addition, the status information is not limited to the operating status of each terminal 10, but the cable is disconnected from the terminal 10 at the terminal 10, audio is output but no image is output, or audio is not output ( Various states such as MUTE) are shown. Below, the case where status information shows an operation state is demonstrated as an example.

  An example of various data that the transmission / reception unit 11 transmits / receives to / from other terminals, devices, or systems via the communication network 2 will be described. For example, the transmission / reception unit 11 transmits start request information to the management system 50 when the user starts communication by specifying a destination terminal from a destination terminal state list image (FIG. 18C, FIG. 28) described later. . The start request information includes start request information by normal transmission and start request information by entry transmission (distribution).

  The start request information by normal transmission is information transmitted when requesting the start of communication in which any terminal 10 can participate (hereinafter referred to as “communication for call”). The start request information by normal transmission includes a terminal ID for identifying the request source terminal, a terminal ID for identifying the destination terminal, and information “Invite” indicating that a call start is requested by communication for a call. .

  The start request information by entering the room is information transmitted when requesting the start of a conference to be performed by communication (hereinafter referred to as “distribution communication”) in which one or more terminals 10 specified in advance can participate. The start request information by entering the room includes a terminal ID for identifying the request source terminal, a terminal ID for identifying the destination terminal, and information “Invite + Room” indicating that the start of a call by communication for distribution is requested. . A conference to be performed by communication for distribution is identified by a conference room ID. In addition, by including the conference room ID instead of the terminal ID in the start request information by the room entry transmission, the communication for distribution may be identified from the start request information by the room entry transmission. Thereby, a later-described meeting management unit 59 of the management system 50 retrieves a terminal ID of a later-described entry management DB 5007 using the terminal ID of the destination terminal as a search key, and acquires the meeting room ID of the retrieved record. Thus, the process of specifying the conference room used for communication can be omitted.

  After transmitting the start request information to the management system 50, the transmission / reception unit 11 receives a session ID and relay device connection information for identifying communication from the management system 50. The relay device connection information is information (such as the IP address and port number of the relay device 30 and authentication information required for connection of the relay device 30) necessary for connecting to the relay device 30 used for communication.

  In addition, the transmission / reception unit 11 receives start response information from the management system 50. The start response information is information indicating whether or not communication with the destination terminal is possible. The start response information includes the terminal ID of the destination terminal, information indicating permission (Accept) or rejection (Reject) of the start of the communication, and a session ID for identifying the communication. When the start response information received from the management system 50 indicates that communication with the destination terminal is possible, the transmission / reception unit 11 transmits the communication session ID and relay device connection information to the relay device 30.

  In addition, the transmission / reception unit 11 transmits an entry request to the management system 50 when the user selects a conference room (conference name) from a conference room list image (see FIG. 19A) described later and starts communication. . The room entry request includes the terminal ID of the request source terminal, information “Invite + Room” indicating that the start of a call by communication for distribution is requested, and the conference room ID of the conference room.

  The operation input receiving unit 12 is realized by the operation button 108 and the power switch 109 shown in FIG. 3 and receives various inputs by the user. For example, when the user turns on the power switch 109 shown in FIG. 3, the operation input receiving unit 12 shown in FIG. 5 receives the power ON and turns on the power. In addition, when the operation input receiving unit 12 receives an operation input for selecting a destination terminal from a destination terminal state list image (see FIG. 28), which will be described later, the start request information by entering the room or the start request information by normal sending. The transmission / reception unit 11 is requested to transmit to the management system 50. Further, the operation input receiving unit 12 transmits and receives a room entry request to the management system 50 when receiving an operation input for selecting a conference room from a conference room list image (see FIG. 19A) described later. 11 is requested.

  The login request unit 13 is realized by a command from the CPU 101 shown in FIG. 3, and the authentication (login) is performed from the transmission / reception unit 11 to the management system 50 via the communication network 2 when receiving the power ON. The login request information indicating that the request is made and the current IP address of the terminal 10 as the request source are automatically transmitted. The login request information includes a terminal ID for identifying the terminal 10 that is the own terminal as a request source, and a password for logging in to the transmission system 1. When the user turns the power switch 109 from the ON state to the OFF state, the transmission / reception unit 11 transmits state information indicating that the power supply is turned off to the management system 50, and then the operation input reception unit 12 completely turns the power supply. Set to OFF. As a result, the management system 50 side can grasp that the terminal 10 has been turned off from being turned on.

  The imaging unit 14a is realized by an instruction from the CPU 101 shown in FIG. 3 and the camera 112a and the imaging device I / F 113 shown in FIG. Output image data. The voice input unit 15a is realized by the voice input / output I / F 116 shown in FIG. 3, and after the user's voice is converted into a voice signal by the microphone 114a, voice data related to the voice signal is input. The audio output unit 16a is realized by the instruction from the CPU 101 shown in FIG. 3 and the audio input / output I / F 116 shown in FIG. 3, and outputs an audio signal related to the audio data to the speaker 115a. The sound is output from 115a.

  The imaging unit 14b is realized by the instruction from the CPU 101 shown in FIG. 3 and the external camera 112b shown in FIG. 3, and images the subject and outputs the image data obtained by the imaging. . The voice input unit 15b inputs voice data related to the voice signal after the user's voice is converted into a voice signal by the external microphone 114b. The audio output unit 16b is realized by a command from the CPU 101 shown in FIG. 3, and outputs an audio signal related to the audio data to the external speaker 115b and outputs audio from the external speaker 115b.

  The display control unit 17 is realized by a command from the CPU 101 illustrated in FIG. 3 and performs control for displaying image data on the external display 120. For example, the display control unit 17 performs control for displaying a destination terminal state list image (see FIG. 18C and FIG. 28) described later and a conference room list image (see FIG. 19A) described later on the display 120. Do.

  Further, the storage / reading processing unit 18 is executed by the instruction from the CPU 101 shown in FIG. 3 and the SSD 105 shown in FIG. 3 as an example, and stores various data in the nonvolatile storage unit 1000 or a nonvolatile storage. Processing for reading various data stored in the unit 1000 is performed. The nonvolatile storage unit 1000 stores a terminal ID (Identification) for identifying the terminal 10, a password, and the like. Further, the storage / reading processing unit 18 stores various data in the volatile storage unit 1100 and reads out various data stored in the volatile storage unit 1100. The volatile storage unit 1100 overwrites and stores image data and audio data received when a call is made with the destination terminal. Among these, the image is displayed on the display 120 by the image data before being overwritten, and the sound is output from the speaker 115a by the sound data before being overwritten.

  The session control unit 19 is a call session (an example of a “first session”) for making a call with another terminal 10 and a distribution session for transmitting audio data to the other terminals 10. (An example of “second session”) is connected.

  The session control unit 19 stops the transmission of audio data in the distribution session when connecting the call session while the distribution session is connected. For example, the session state and the type of the session are stored, and when it is detected that the call session is connected while the distribution session is connected, or the voice from the management system 50 When the distribution stop request is received, the distribution microphone is muted or the audio data is excluded from the distribution session. Thereby, it is possible to prevent howling and to prevent the content of a private call from being leaked to the user of the terminal 10 receiving the distribution.

  When the session control unit 19 cannot connect a call session or receives a recording request from the terminal 10 that is the destination of the call session, the session control unit 19 records content data such as video and audio, and stores the recorded content data. Then, the data is transmitted to the destination terminal 10 of the call session via the management system 50 using the transmission / reception unit 11.

  The session control unit 19 is connected to a distribution session and receives a call session connection request while receiving content distribution, and responds based on a response operation from the user or the management. When the system 50 requests withdrawal (exit) from the distribution session, the system 50 leaves the distribution session.

  Note that the terminal ID and the relay device ID described later are identification information for uniquely identifying the terminal 10 and the relay device 30, respectively. The identification information is a language, characters, symbols, various signs, or the like. Further, the terminal ID and the relay device ID may be identification information in which at least two of the language, characters, symbols, and various signs are combined. The same applies to the session ID and conference room ID.

  The destination list creating unit 20 creates a destination list (destination terminal status list information) based on information of “multiple session permission flag”, destination list information, status information, and conference room presence information described later.

  In the destination list, the destination list creation unit 20 displays information indicating that a call cannot be made to the terminal 10 that is in an active state where incoming calls cannot be made. For example, the destination list creation unit 20 creates a list so that a button to be transmitted to the terminal 10 whose operation state is “ON line (during a call)” or “OFF line” cannot be pressed. On the other hand, a list is created so that a button to be transmitted to the terminal 10 whose operation states are “ON line (call possible)” and “ON line (during transmission)” can be pressed.

  The destination list creation unit 20 is a case where the terminal 10 cannot connect a plurality of sessions in parallel, and when the terminal 10 is connected to a distribution session or a call session, Information indicating that transmission to each terminal 10 is not possible is displayed. Specifically, when the information of the “multiple session permission flag” notified from the management system 50 is not on, it is determined that the terminal 10 cannot connect a plurality of sessions in parallel.

  The destination list creating unit 20 uses the display control unit 17 to display the created destination list on the screen (see FIGS. 18C and 28).

(Functional configuration of relay device)
Next, functions or means of the relay device 30 will be described. The relay device 30 includes a transmission / reception unit 31, a state detection unit 32, and a storage / reading processing unit 33. Each of these units is a function or means realized by any one of the constituent elements shown in FIG. 4 operating according to a command from the CPU 201 according to a program stored in the ROM 202. In addition, the relay device 30 includes a non-volatile storage unit 3000 that is constructed by the HD 204 shown in FIG. 4 and that stores various data and information even when the power of the relay device 30 is turned off.

<Each functional unit of the relay device>
Next, each functional configuration of the relay device 30 will be described in detail. In the following, in describing each part of the relay device 30, a relationship with main components for realizing each part of the relay device 30 among the components illustrated in FIG. 4 will also be described.

  The transmission / reception unit 31 of the relay device 30 shown in FIG. 5 is realized by the network I / F 209 shown in FIG. 4, and other terminals, devices, or systems and various data (or the data (or Information). For example, the transmission / reception unit 31 receives a session ID and relay device connection information from the terminal 10.

  The state detection unit 32 is realized by a command from the CPU 201 illustrated in FIG. 4, and detects the operating state of the relay device 30 having the state detection unit 32. The operating state includes “ON line”, “OFF line”, and “failing” state. The state detection unit 32 transmits the operating state to the management system 50 via the transmission / reception unit 31.

  The storage / reading processing unit 33 stores various data in the non-volatile storage unit 3000 and reads out various data stored in the non-volatile storage unit 3000.

<Functional configuration of management system>
Next, functions or means of the management system 50 will be described. First, information stored in the management system 50 will be described. The management system 50 is constructed by the HD 204 shown in FIG. 4, and has a non-volatile storage unit 5000 that maintains the storage of various data and information even when the management system 50 is turned off. Further, the management system 50 has a volatile storage unit 5100 constructed by the RAM 203 shown in FIG.

(Relay device management table)
In the nonvolatile storage unit 5000, a relay device management DB 5001 configured by a relay device management table as shown in FIG. 6 is constructed. In this relay device management table, for each relay device ID of each relay device 30, the operating status of each relay device 30, the reception date and time when status information indicating the operating status is received by the management system 50, and the IP address of the relay device 30 , And the maximum data transmission rate (Mbps) in the relay device 30 is managed in association with each other. For example, in the relay device management table shown in FIG. 6, the relay device 30 a with the relay device ID “111a” has an “ON line” operating state and the date and time when the management system 50 received the status information “ "November 10, 2009 13:00" indicates that the IP address of the relay device 30a is "1.2.1.2" and the maximum data transmission rate in the relay device 30a is 100 Mbps. ing.

(Terminal authentication management table)
Further, in the nonvolatile storage unit 5000, a terminal authentication management DB 5002 configured by a terminal authentication management table as shown in FIG. In this terminal authentication management table, a password for logging in to the transmission system 1 is managed in association with each terminal ID of all terminals 10 managed by the management system 50. For example, the terminal authentication management table shown in FIG. 7 indicates that the terminal ID of the terminal 10aa is “01aa” and the password is “aaaa”. Information of the terminal authentication management table is registered in advance by a user or an administrator of the management system 50.

(Terminal management table)
In the nonvolatile storage unit 5000, a terminal management DB 5003 configured by a terminal management table as shown in FIG. 8 is constructed. In this terminal management table, for each terminal ID of each terminal 10, the terminal name when each terminal 10 is the destination, the operating state of each terminal 10, the reception date and time when the login request information was received by the management system 50, the terminal 10 Are managed in association with each other, an IP address, a plurality of session permission flags that are information indicating whether or not a plurality of sessions can be connected in parallel, and the number of sessions that are connected to the outside. For example, in the terminal management table shown in FIG. 8, the terminal 10aa with the terminal ID “01aa” is managed with the terminal name “AA nursery school AA terminal” and the operation state “ON line (call possible)”. It is indicated that the date and time when the login request information is received by the system 50 is “13:40 on November 10, 2009” and the IP address of this terminal 10aa is “1.2.1.3”. Yes.

(Destination list management table)
Further, in the nonvolatile storage unit 5000, a destination list management DB 5004 configured by a destination list management table as shown in FIG. 9 is constructed. In the destination list management table, a destination terminal ID is associated with each request source terminal ID and managed. The request source terminal ID is information for identifying the request source terminal that requests the start of a call. The destination terminal ID is information for identifying a destination terminal that is a candidate for a destination terminal for communication of a request source terminal that requests the start of a call. This destination terminal candidate is updated by being added or deleted in response to a request for addition or deletion from the request source terminal to the management system 50. For example, in the destination list management table shown in FIG. 9, the destination terminal candidate that can request the start of a call in a video conference from the request source terminal (terminal 10aa) whose terminal ID is “01aa” is the terminal A terminal 10ab with an ID “01ab”, a terminal 10ba with a terminal ID “01ba”, a terminal 10bb with a terminal ID “01bb”, a terminal 10ca with a terminal ID “01ca”, and a terminal 10db with a terminal ID “01db” It is shown that there is.

(Session management table)
Further, in the nonvolatile storage unit 5000, a session management DB 5005 configured by a session management table as shown in FIG. 10 is constructed. In this session management table, for each session ID for identifying communication between terminals, the relay device ID of the relay device 30 used for relaying image data and audio data, the terminal ID of the request source terminal, and the terminal of the destination terminal An ID is associated and managed. When the terminal ID of the request source terminal and the terminal ID of the destination terminal are the same, this is a session for distributing image data and audio data from the request source terminal, and that there is no terminal 10 that receives the distribution yet. Show. For example, in the session management table shown in FIG. 10, the relay device 30e (relay device ID “111e”) selected in the session executed using the session ID “se1” has the terminal ID “01aa”. It is shown that image data and audio data of the request source terminal (terminal 10aa) are distributed. Further, the relay device 30e (relay device ID “111e”) selected in the session executed using the session ID “se2” has the request source terminal (terminal 10aa) with the terminal ID “01aa” and the terminal ID It is shown that image data and audio data are relayed to the destination terminal (terminal 10ab) of “01ab”.

(Relay device selection management table)
Furthermore, in the nonvolatile storage unit 5000, a relay device selection management DB 5006 configured by a relay device selection management table as shown in FIG. 11 is constructed. In this quality management table, each terminal ID of all terminals 10 managed by the management system 50 is managed in association with the relay apparatus ID of the relay apparatus 30 used for relaying image data and audio data. .

(Room management table)
Further, in the nonvolatile storage unit 5000, an entrance management DB 5007 configured by an entrance management table as shown in FIG. 12 is constructed. This room entry management table includes a conference room ID for identifying a conference and a designated one or more terminals 10 for each conference (distribution) that is performed by communication for distribution that allows one or more designated terminals 10 to participate. The terminal ID is stored in association with the terminal ID. In the example of FIG. 12, in the conference room ID “1”, the content data from the head terminal (terminal ID “01aa”) is transferred to other terminals (terminal IDs “01ab”, “01e1”, “01e2”, ..)).

(Conference room management table)
Furthermore, a conference room management DB 5008 configured by a conference room management table as shown in FIG. 13 is constructed in the nonvolatile storage unit 5000. This conference room management table is identified by a conference room ID for identifying a conference, a conference name, and the conference room ID for each conference that is performed by distribution communication that allows one or more designated terminals 10 to participate. And the session ID of the communication for distribution. The conference room ID is conference identification information for identifying a virtually created conference room or a conference to be held.

(Each functional part of the management system)
Next, each functional unit of the management system 50 will be described in detail. In the following, in describing each part of the management system 50, a relationship with main constituent elements for realizing each part of the management system 50 among the constituent elements shown in FIG. 4 will also be described. The management system 50 includes a transmission / reception unit 51, a terminal authentication unit 52, a state management unit 53, a terminal extraction unit 54, a terminal state acquisition unit 55, a relay device selection unit 56, a session management unit 57, a session control unit 58, and a conference management unit 59. And a storage / reading processing unit 60. Each of these units is a function or means realized by any one of the constituent elements shown in FIG. 4 operating according to a command from the CPU 201 according to a program stored in the ROM 202.

  The transmission / reception unit 51 is executed by the network I / F 209 illustrated in FIG. 4, and transmits / receives various data to / from other terminals, devices, or systems via the communication network 2.

  For example, when the user of the terminal 10 starts communication by designating the destination terminal from the destination terminal state list image (FIG. 18C, FIG. 28), which will be described later, the transmission / reception unit 51 starts the start request information by entering the room. Alternatively, start request information by normal transmission is received from the terminal 10.

  Further, after receiving the start request information from the terminal 10, the transmission / reception unit 51 transmits a session ID and relay device connection information for identifying communication to the terminal 10.

  Further, after receiving the start request information from the communication request source terminal 10, the transmission / reception unit 51 sends the start request information, the relay device connection information, and the IP address of the management system 50 to the communication destination terminal 10. Send.

  In addition, after receiving the start response information from the communication destination terminal 10, the transmission / reception unit 51 transmits the start response information to the communication request source terminal 10.

  The terminal authentication unit 52 searches the terminal authentication management table (see FIG. 7) of the nonvolatile storage unit 5000 using the terminal ID and password included in the login request information received via the transmission / reception unit 51 as search keys. The terminal authentication is performed by determining whether the same terminal ID and password are managed in the terminal authentication management table.

  The state management unit 53 stores the terminal ID of the request source terminal, the terminal name of the request source terminal, and the request source terminal in the terminal management table (see FIG. 8) in order to manage the operating status of the request source terminal that has requested login. The operating state, the reception date and time when the management system 50 receives the login request information, and the IP address of the request source terminal are stored and managed in association with each other.

  Among these, the state management unit 53 sets (changes) the state information of the terminal 10 in the terminal management table (see FIG. 8) when information indicating that the state of the terminal 10 has been changed is received from the terminal 10. To do. For example, when the user of the terminal 10 turns the power switch 109 of the terminal 10 from the OFF state to the ON state, the terminal 10 transmits state information indicating that the power is turned ON to the management system 50. When the state management unit 53 receives the state information via the transmission / reception unit 51, the state management unit 53 changes the operation state of the terminal 10 in the terminal management table (see FIG. 8) from “OFF line” to “ON line (call possible)”. Change to When the user turns the power switch 109 of the terminal 10 from the ON state to the OFF state, the terminal 10 transmits state information indicating that the power source is turned off to the management system 50. When the status management unit 53 receives the status information via the transmission / reception unit 51, the status management unit 53 changes the operating status of the terminal 10 in the terminal management table (see FIG. 8) from “ON line (call possible)” to “OFF line”. Change to

  When the state management unit 53 receives information indicating that the state of the terminal 10 has been changed from the terminal 10, the state management unit 53 notifies each of the other terminals 10 destined for the terminal 10 of the changed operation state. Thereby, in the destination terminal state list image displayed on each of the other terminals 10 (see FIG. 18C and FIG. 28), the display of the operating state of the terminal 10 whose state has been changed is updated.

  Specifically, the state management unit 53 searches the destination terminal ID in the destination list management table (see FIG. 9) using the terminal ID of the terminal 10 whose state has been changed as a search key, and the terminal 10 whose state has been changed. The other terminals 10 whose destinations are are extracted. Then, the operation status of the terminal 10 whose state has been changed is notified to each of the other extracted terminals 10.

  The terminal extraction unit 54 searches the request source terminal ID in the destination list management table (see FIG. 9) using the terminal ID of the request source terminal that requested the login as a search key, and extracts the destination terminal ID of the searched record. The terminal extraction unit 54 extracts the terminal 10 identified by the extracted destination terminal ID as a destination terminal candidate that can talk to the request source terminal.

  For each destination terminal candidate terminal ID extracted by the terminal extraction unit 54, the terminal state acquisition unit 55 searches the terminal ID in the terminal management table (see FIG. 8) using the terminal ID as a search key, and performs a search. Read the operating status of the recorded record. Thereby, the terminal state acquisition unit 55 can acquire the operating state of the candidate destination terminal that can make a call with the request source terminal that has requested the login.

  The relay device selection unit 56 generates a session ID for identifying a session in which call data is communicated between terminals. The relay device selection unit 56 uses the relay device selection management table (see FIG. 11) based on the terminal ID of the request source terminal and the terminal ID of the destination terminal included in the start request information sent from the request source terminal. Is retrieved, the corresponding relay device ID is extracted. The relay device selection unit 56 selects the relay device ID of the relay device 30 whose operation state is “ON line” from among the relay devices 30 managed in the relay device management table (see FIG. 6). The relay device 30 is selected.

  The session management unit 57 manages a distribution session for transmitting content data from one terminal to one or more other terminals and a call session for transmitting content data bidirectionally between a plurality of terminals. To do. Specifically, the session management unit 57 adds the session ID generated by the session ID generation unit 56a, the terminal ID of the request source terminal, and the destination terminal to the session management table (see FIG. 10) of the nonvolatile storage unit 5000. Store and manage terminal IDs in association with each other. In addition, the session management unit 57 stores and manages the relay device ID of the selected relay device 30 for each session ID in the session management table. In addition, the session management unit 57 stores the session ID of the communication for distribution identified by the conference room ID in association with the conference room ID in the conference room management table.

  The session control unit 58 performs session management processing. In this session management process, the session control unit 58 makes a connection request (outgoing) from the terminal 10 or a connection request (incoming call) from the terminal 10 while the terminal 10 is connected (established). ), It is determined whether to permit the connection request based on information managed by the terminal management DB 5003. If the session control unit 58 determines to permit, the session control unit 58 transfers the connection request to the destination terminal 10. If not permitted, the connection request is rejected and an error is returned to the requesting terminal 10. A detailed example of the session management process will be described later.

  When the session control unit 58 receives a response to the connection request from the destination terminal 10 or receives a connection request to the destination terminal 10, the session control unit 58 selects the destination based on the information managed by the terminal management DB 5003. Terminal 10 can determine whether a plurality of sessions can be connected in parallel. If the destination terminal 10 cannot connect a plurality of sessions in parallel, or if the destination terminal 10 is connected to another session, the session control unit 58 moves the destination terminal 10 from the other session. Let go. In this case, if the destination terminal 10 is connected to another session, the session control unit 58 causes the destination terminal 10 to leave the other session and then to the destination terminal 10. The connection request may be transferred. As a result, the destination terminal 10 does not need to have a function of responding to another session while one session is connected, so that a normal terminal 10 that cannot handle multiple sessions at the same time can be used as the destination terminal 10. It becomes.

  When the terminal 10 serving as the distribution source connects (establishes) a call session to the terminal 10 while the distribution session is connected to the terminal 10 serving as the distribution source, the session control unit 58 It is determined whether audio data from is being transmitted. When the voice data is transmitted, for example, the relay device 30 instructs the terminal 10 to stop the transmission of the voice data or discards the voice data transmitted from the terminal 10 in the distribution session. To stop transmission of audio data. In that case, the session control unit 58 sends to each terminal 10 connected to the distribution session, for example, “Voice distribution is currently stopped because the distribution source is busy”. Notify that voice data transmission is stopped by voice or message.

  The conference management unit 59 stores and manages the conference room ID and the terminal ID in the room entry management table (see FIG. 12) of the nonvolatile storage unit 5000 in association with each other. In addition, the conference management unit 59 stores and manages the conference room ID, the conference name, and the session ID in the conference room management table (see FIG. 13) of the nonvolatile storage unit 5000 in association with each other.

  The conference management unit 59 receives, from the communication request source terminal 10, a room entry transmission start request indicating the start of distribution communication identified by the conference room ID via the transmission / reception unit 51. The room entry transmission start request includes the terminal ID of the request source terminal and information (conference room ID or terminal ID of the destination terminal) for specifying the conference room to be entered. The conference management unit 59 identifies the conference room ID of the conference room to be entered from the information for identifying the conference room included in the entry transmission start request, and the terminal ID of the request source terminal 10 included in the entry transmission start request Is associated with the conference room ID. When the conference management unit 59 is associated, the conference management unit 59 requests the session management unit 57 to perform the session management processing for the communication for distribution related to the request to start entering the room.

  The storage / reading processing unit 60 (corresponding to the destination terminal information management unit) stores various data in the nonvolatile storage unit 5000 or the volatile storage unit 5100, or is stored in the nonvolatile storage unit 5000 or the volatile storage unit 5100. To read various data.

<< Processing or Operation of Embodiment >>
The above is the description of the configuration and function (or means) of the transmission system 1 according to the present embodiment, and subsequently, the processing method in the transmission system 1 according to the present embodiment is described with reference to FIGS. 14 to 34. .

  First, with reference to FIG. 14, an outline of the operation of the transmission system 1 when a call is made during distribution in the embodiment will be described. FIG. 14 is a sequence diagram of the transmission system 1 when a call is made during distribution. In the example of FIG. 14, at least one of video and audio is transferred from the terminal 10-1 (first terminal) to the terminal 10-2 (second terminal), 10-3 (third terminal),. This is an example of a case where a call is made from the terminal 10-1 to the terminal 10-2 during distribution and distribution. In the example of FIG. 14, the management system 50 and the relay device 30 are described as an integral unit for the sake of simplicity, but transmission of content data such as video and audio is performed via the relay device 30.

  The distribution source terminal 10-1 requests the management system 50 to start a distribution session by designating a predetermined conference room ID (step S101).

  The management system 50 starts a distribution session (step S102).

  The distribution source terminal 10-1 enters the distribution conference room, and transmits the distribution video and audio (step S103).

  The plurality of delivery destination terminals 10-2, 10-3,... Specify a predetermined conference room ID and connect to the delivery session of the management system 50 (steps S104-1, S104-2), Distribution video and audio are received from the distribution source terminal 10-1 via the relay device 30 (not shown) (steps S105-1 and S105-2).

  The terminal 10-1 transmits a connection request (start request information) to the designated destination terminal 10-2 to the management system 50 in response to the call connection operation designating the destination from the user (step S106). Note that, before the call connection operation, an operation for requesting a destination list from the user may be received, and a destination may be specified from the destination list acquired from the management system 50.

  The management system 50 performs session management processing (step S107), and transfers the connection request to the destination terminal 10-2 (step S108). Details of the session management process will be described later.

  Upon receiving the connection request, the destination terminal 10-2 performs incoming processing (step S109), and returns a response to the management system 50 in response to a response operation from the user (step S110). Details of the incoming call processing will be described later.

  The management system 50 performs terminal management and session management (step S111). Specifically, the value of the “number of sessions” associated with the requesting terminal 10-1 in the terminal management DB 5003 is increased by one. In the terminal management DB 5003, the “operating state” associated with the destination terminal 10-2 is changed to “ON line (during a call)”. In addition, the session management DB 5005 records the session ID, the ID of the request source terminal 10-1, the ID of the destination terminal 10-2, and the like.

  If the “operating state” associated with the destination terminal 10-2 in the terminal management DB 5003 is “ON line (during transmission)”, the management system 50 sends a distribution session to the destination terminal 10-2. Requests disconnection from (step S112).

  The destination terminal 10-2 terminates the distribution session, and notifies the management system 50 of disconnection from the distribution session (step S113).

  The management system 50 leaves the destination terminal 10-2 from the distribution session (step S114).

  When the audio data from the request source terminal 10-1 is transmitted in the distribution session, the management system 50 stops the transmission of the audio data in the distribution session to the request source terminal 10-1. An instruction is given (step S115).

  The request source terminal 10-1 stops transmission of audio data in the distribution session (step S116).

  The management system 50 notifies the distribution destination terminals 10-3,... Connected to the distribution session that the distribution of the audio data has been stopped (step S117).

  The management system 50 transfers the response from the destination terminal 10-2 to the request source terminal 10-1 (step S118).

  The requesting terminal 10-1 connects the call (step S119), and starts communication between the two parties with the terminal 10-2 (step S120).

  The requesting terminal 10-1 transmits a disconnection request addressed to the terminal 10-2 to the management system 50 in response to a call disconnecting operation from the user (step S121).

  The management system 50 performs terminal management and session management (step S122). Specifically, the value of “number of sessions” associated with the request source terminal 10-1 in the terminal management DB 5003 is decreased by one. In the terminal management DB 5003, the “operation state” associated with the destination terminal 10-2 is changed to “ON line (call possible)”. Further, the session ID, the ID of the terminal 10-1, the ID of the terminal 10-2, etc., recorded in the session management DB 5005 are deleted. The management system 50 transfers the disconnection request to the destination terminal 10-2 (step S123).

  The destination terminal 10-2 ends the communication between the two parties with the terminal 10-1 (step S124).

  Next, with reference to FIG. 15, the operation when the distribution source terminal 10-1 of FIG. 14 makes a call during distribution will be described. FIG. 15 is a flowchart of processing when the distribution source terminal 10-1 makes a call during distribution.

  The requesting terminal 10-1 starts (establishes) a distribution session (step S201), displays the video of the distribution camera on the screen, and distributes the video and the audio of the distribution microphone (step S202). ).

  When an operation for making a call is accepted, a destination list is displayed while the distribution continues (step S203).

  When a call operation specifying a destination is accepted (step S204), the call is sent to the destination terminal 10-2 (step S205).

  When a call session with the destination terminal 10-2 is started (step S206), the video of the contact camera and the voice of the contact microphone are validated (transmitted) (step S207) and distributed to prevent howling. The voice of the service microphone is invalidated (step S208).

  When the call session ends (step S209), the video of the contact camera and the voice of the contact microphone are invalidated and the screen returns to the screen displaying the video of the distribution camera (step S210).

  Next, the details of the session management process of the management system 50 shown in step S107 of FIG. 14 will be described with reference to FIG. FIG. 16 is a flowchart of the session management process.

  The management system 50 receives a connection request addressed to the destination terminal 10-2 from the request source terminal 10-1 (step S301). With reference to the terminal management DB 5003, it is determined whether the “multiple session permission flag” associated with the requesting terminal 10-1 is ON (step S302).

  If the flag is not on (NO in step S302), the connection request is rejected and an error response is returned to the requesting terminal 10-1 (step S303).

  If the flag is on (YES in step S302), the terminal management DB 5003 is referenced to determine whether the “number of sessions” associated with the requesting terminal 10-1 is 1 or less (step S304).

  If it is not less than 1 (NO in step S304), the process proceeds to step S303 described above, the connection request is rejected, and an error response is returned to the requesting terminal 10-1.

  If it is 1 or less (YES in step S304), the terminal management DB 5003 is referred to, and the "operating state" associated with the destination terminal 10-2 is "ON line (call possible)" or "ON line (during transmission). ) ”(Step S305).

  If it is not “ON line (can call)” or “ON line (during transmission)” (NO in step S305), the process proceeds to step S303 described above to reject the connection request and return an error response to the requesting terminal 10-1. return it.

  If it is “ON line (can call)” or “ON line (during transmission)” (YES in step S305), the connection request is transferred to the destination terminal 10-2 (step S306).

  Next, with reference to FIG. 17, the operation when the destination terminal 10-2 receives the incoming call when the destination terminal 10-2 is receiving the delivery shown in step S109 of FIG. 14 will be described. FIG. 17 is a flowchart of the incoming call processing of the destination terminal 10-2.

  When the destination terminal 10-2 receives the connection request from the request source terminal 10-1 via the management system 50 (step S401), the destination terminal 10-2 determines whether another call (session) has already been made (step S402). .

  If another call is not being made (NO in step S402), an incoming call is notified (step S403). If the response button is subsequently pressed, a response (start response information) is transmitted to the requesting terminal 10-1 via the management system 50.

  If another call is being made (YES in step S402), the incoming call is notified and a response button and a recording button are displayed (step S404). A button for rejecting an incoming call may also be displayed.

  It is determined which button is pressed by the user (step S405), and when the recording button is pressed (recording button in step S405), a recording request is transmitted to the requesting terminal 10-1 via the management system 50. (Step S406).

  When the response button is pressed (response button in step S405), a response (start response information) is transmitted to the request source terminal 10-1 via the management system 50 (step S407).

  Next, an example of the screen display of the distribution source terminal 10-1 in FIG. 14 will be described with reference to FIG. FIG. 18A is an example of a display screen when the distribution function is activated. A “video distribution” button 501 and a “participant edit” button 502 are displayed. FIG. 18B is an example of a screen display when the “video distribution” button 501 is pressed and distribution is performed in step S103 of FIG. The video of the camera 112a being distributed is displayed on the display 120 of the terminal 10 itself. In addition, a “contact” button 503 is displayed.

  FIG. 18C is a screen display example when the “contact” button 503 is pressed. A destination list is displayed on the upper layer in the screen. The user can select a call destination from the destination list. The destination list screen in FIG. 18C is the same as the screen in FIG. 28 described later. FIG. 18D is a screen display example when a call is made in step S120 of FIG. The other party's video 504 and his own video 505 taken by the external camera 112b are displayed. When the call ends, the screen returns to the screen of FIG.

  Next, an example of the screen display of the delivery destination terminal 10-2 in FIG. 14 will be described with reference to FIG. FIG. 19A is an example of a display screen when the distribution function is activated. Information indicating conference rooms for delivery (AA nursery school and BA nursery school) where the delivery destination terminal 10-2 can enter is displayed. FIG. 19B is a screen display example when entering a conference room for distribution. The content data distributed from the distribution source terminal 10-1 is displayed.

  FIG. 19C is an example of a screen display when a call is received from the terminal 10-1 during distribution. A “response” button 601 and a “record” button 602 are displayed.

  FIG. 19D is a screen display example when the “response” button 601 is pressed. The other party's video 603 and his / her video 604 are displayed.

  FIG. 19E shows a screen display example when the “record” button 602 is pressed. A message indicating that recording is in progress is displayed. FIG. 19F is an example of a screen display when there is a recording at the terminal 10-1. The recording is displayed.

  Next, the concept showing the transmission / reception state of image data, audio data, and various management information in the transmission system 1 will be described with reference to FIG. FIG. 20 is a conceptual diagram illustrating a state of transmission / reception of image data, audio data, and various management information in the transmission system 1. As shown in FIG. 20, in the transmission system 1, a management information session sei for transmitting and receiving various types of management information is established between the terminal 10A, the terminal 10B, and the terminal 10C via the management system 50. Is done. In addition, the terminal 10A, the terminal 10B, and the terminal 10C transmit and receive four types of data, that is, high-resolution image data, medium-resolution image data, low-resolution image data, and audio data, via the relay device 30. Four sessions for are established. Here, these four sessions are collectively shown as an image / audio data session sed.

  Next, a detailed example of the process of FIG. 14 will be described. In addition, the case where the terminals 10-1, 10-2, and 10-3 in FIG. 14 are 10aa, 10ab, and 10e1, respectively, will be described as an example.

  First, a detailed example of the distribution function using the conference room (distribution room) of the transmission system 1 of the present embodiment in steps S101 to S105 in FIG. 14 will be described. The distribution function is a function for performing communication for distribution in which participation between the request source terminal and one or more destination terminals is restricted. First, a process for creating a new conference room for distribution will be described.

  When the operation input reception unit 12 of the terminal 10 receives an operation input indicating that the conference room new creation button is pressed from the user, the display control unit 17 of the terminal 10 displays a new conference room creation image on the terminal 10. FIG. 21 is a diagram showing a new conference room creation image displayed when a conference room is newly created.

  Here, the processing flow of the terminal 10 and the management system 50 when the user selects a distribution application and newly creates a conference room will be described by taking the case of the user of the terminal 10aa as an example. FIG. 22 is a sequence diagram showing processing when a new conference room is created.

  The operation input receiving unit 12 of the terminal 10aa receives an operation input indicating that the new creation button has been pressed from the user (step S501). The transmission / reception unit 11 of the terminal 10aa transmits a destination terminal information acquisition request including the terminal ID “01aa” of the terminal 10aa to the management system 50 (step S502).

  The terminal extraction unit 54 of the management system 50 receives the destination terminal information acquisition request via the transmission / reception unit 51. Based on the terminal ID “01aa” of the terminal 10aa included in the destination terminal information acquisition request, the terminal extraction unit 54 obtains destination terminal information (terminal ID, terminal name, and operating state) of the destination terminal associated with the terminal 10aa. Obtain (step S503). Specifically, the terminal extraction unit 54 first searches the request source terminal ID in the destination list management DB 5004 using the terminal ID “01aa” of the terminal 10aa included in the destination terminal information acquisition request as a search key, and is searched. The destination terminal ID (“01ab”, “01e1”, “01e2”,...) Of the record is acquired. Next, the terminal extraction unit 54 searches for the terminal ID of the terminal management DB 5003 using each of the destination terminal IDs (“01ab”, “01e1”, “01e2”,...) As a search key. Get the terminal name and operating status of the record. For example, when the search key is “01ba”, the terminal extraction unit 54 acquires the terminal name “BA terminal” and the operation state “ON line (call possible)” from the record of the terminal management DB 5003.

  Next, the terminal extraction unit 54 transmits destination terminal information including the terminal ID, the terminal name, and the operating state acquired in Step S503 via the transmission / reception unit 51 to the terminal 10aa (Step S504). The display control unit 17 of the terminal 10aa receives the destination terminal information via the transmission / reception unit 11. The display control unit 17 displays a newly created conference room image (see FIG. 21) including the terminal ID, the terminal name, and the operating state of the destination terminal information on the terminal 10aa. The operation input accepting unit 12 of the terminal 10aa accepts an operation input indicating a conference name and selection of the terminal 10 that can participate in the conference (step S505). The operation input reception unit 12 of the terminal 10aa transmits the conference room new creation information including the conference name and the terminal ID of the terminal 10 that can participate in the conference to the management system 50 via the transmission / reception unit 11 (step S506).

  Next, the conference management unit 59 of the management system 50 receives the conference room new creation information via the transmission / reception unit 51. The conference management unit 59 newly creates a conference room ID corresponding to the conference name included in the new conference room creation information. The conference management unit 59 creates a record in which the conference room ID and the conference name are associated with each other in the conference room management DB 5008. In addition, the conference management unit 59 creates a record that associates the conference room ID with the terminal ID included in the new conference room creation information in the entrance management DB 5007 (step S507).

  The conference management unit 59 transmits a conference room information registration notification indicating that a new conference room has been created via the transmission / reception unit 51 to the terminal 10aa (step S508). Upon receiving the conference room information registration notification via the transmission / reception unit 11, the display control unit 17 of the terminal 10aa displays a registration completion image including information indicating that the conference room registration is completed on the terminal 10aa (step S509). .

  Next, the display of detailed information on the conference room for distribution and the flow of processing of the terminal 10 and the management system 50 when editing the conference room information (conference name and terminal 10 that can participate) will be described. First, the meeting room detailed image which shows the detailed information of a meeting room is demonstrated. FIG. 23 is a diagram showing a conference room detailed image showing detailed information of the conference room. The detailed conference room image in FIG. 23 includes a conference name, information on terminals 10 that can participate (terminal ID, terminal name, and operating state), an entry button, an edit button, and a cancel button. The conference name is the name of the conference room. Information (terminal ID, terminal name, and operating state) of the terminal 10 that can participate is information of the terminal 10 associated with the conference. The room entry button is a button that the user presses when communication is started using the conference room having the conference name. The edit button is a button that the user presses when editing the meeting room information (the meeting name and the terminal 10 that can participate) of the meeting room with the meeting name. The cancel button is a button that the user presses when returning to the conference room list image.

  When the operation input accepting unit 12 of the terminal 10 accepts pressing of the edit button, the display control unit 17 of the terminal 10 displays the conference room edited image on the terminal 10. FIG. 24 is a diagram showing a conference room edit image displayed when editing conference room information. The conference room edit image includes a conference name, information on the terminal 10 that can be registered for participation (terminal ID, terminal name, and operating state), information indicating the currently designated terminal 10 among the terminals 10 that can be registered for registration, an update button, Includes a cancel button. The conference name is the name of the conference room. The information (terminal ID, terminal name, and operating state) of the terminal 10 that can be registered for participation is information on the destination terminal associated with the terminal 10 that edits the conference room information. The information indicating the terminal 10 currently designated among the terminals 10 that can be registered for participation is information indicating the terminal 10 specified by the terminal ID associated with the conference room ID corresponding to the conference name. In the example of FIG. 24, the terminal information with a check is information indicating the currently designated terminal 10 among the terminals 10 that can be registered for participation. The update button is a button that the user presses when confirming the edited conference room information. The cancel button is a button that the user presses when canceling the editing of the conference room information and returning to the conference room detailed image.

  Here, the processing flow of the terminal 10 and the management system 50 when the user selects a distribution application and edits the conference room information will be described by taking the case of the user of the terminal 10aa as an example. FIG. 25 is a sequence diagram showing processing at the time of conference room list display and conference room editing.

  Steps S521 to S525 are the same as steps S541 to S545 of FIG.

  Next, the operation input reception unit 12 of the terminal 10aa receives an operation input indicating selection of an AA nursery school included in the conference room list image from the user (step S526). The transmission / reception unit 11 of the terminal 10aa transmits a destination terminal information acquisition request including the conference room ID “1” of the AA nursery school to the management system 50 (step S527).

  The conference management unit 59 of the management system 50 receives the destination terminal information acquisition request via the transmission / reception unit 51. Based on the conference room ID “1” of the AA nursery included in the destination terminal information acquisition request, the conference management unit 59 sets the terminal IDs (“01ab”, “01e1” of the destination terminal associated with the conference room ID “1”. And “01e2”). Next, the terminal extraction unit 54 searches the terminal ID of the terminal management DB 5003 using each of the destination terminal IDs (“01ab”, “01e1”, and “01e2”) as search keys, and searches the terminal of the searched record Get name and operating status. For example, when the search key is “01ab”, the terminal extraction unit 54 acquires the terminal name “AB terminal” and the operation state “OFF line” from the record of the terminal management DB 5003 (step S528).

  Next, the terminal extraction unit 54 transmits destination terminal information including the terminal ID, the terminal name, and the operating state acquired in Step S228 via the transmission / reception unit 51 to the terminal 10aa (Step S529). The display control unit 17 of the terminal 10aa receives the destination terminal information via the transmission / reception unit 11. The display control unit 17 displays the conference room detailed image (see FIG. 23) including the terminal ID, the terminal name, and the operating state of the destination terminal information on the terminal 10aa (Step S530). Next, the operation input accepting unit 12 of the terminal 10aa accepts pressing of an edit button (step S531). Next, the transmission / reception unit 51 of the terminal 10aa transmits an edit candidate destination terminal information acquisition request including the terminal ID “01aa” of the terminal 10aa to the management system 50 (step S532).

  The terminal extraction unit 54 of the management system 50 receives the edit candidate destination terminal information acquisition request via the transmission / reception unit 51. Based on the terminal ID “01aa” of the terminal 10aa included in the edit candidate destination terminal information acquisition request, the terminal extraction unit 54 stores destination terminal information (terminal ID, terminal name, and operating state) of the destination terminal associated with the terminal 10aa. ) Is acquired (step S533). Specifically, the terminal extraction unit 54 first searches the request source terminal ID in the destination list management DB 5004 using the terminal ID “01aa” of the terminal 10aa included in the edit destination terminal information acquisition request as a search key, and performs a search. The destination terminal ID (“01ab”, “01e1”, “01e2”,...) Of the recorded record is acquired. Next, the terminal extraction unit 54 searches for the terminal ID of the terminal management DB 5003 using each of the destination terminal IDs (“01ab”, “01e1”, “01e2”,...) As a search key. Get the terminal name and operating status of the record. For example, when the search key is “01ab”, the terminal extraction unit 54 acquires the terminal name “AB terminal” and the operation state “OFF line” from the record of the terminal management DB 5003.

  Next, the terminal extraction unit 54 transmits the edit candidate destination terminal information (destination terminal state information) including the terminal ID, the terminal name, and the operation state acquired in step S233 via the transmission / reception unit 51 to the terminal 10aa (step S534). ). When the display control unit 17 of the terminal 10aa receives the editing candidate destination terminal information through the transmission / reception unit 11, the display control unit 17 displays a conference room editing image (see FIG. 24) of the AA nursery including the editing candidate destination terminal information on the terminal 10aa ( Step S535). In the conference room edited image of FIG. 24, the destination terminal information with the check is the destination terminal information of the destination terminal currently specified, and the destination terminal information without the check is the destination that can be specified by the terminal 10aa. This is terminal destination terminal information.

  The operation input reception unit 12 of the terminal 10aa receives an operation input related to editing of the conference room information (conference name and the terminal 10 that can participate) of the AA nursery school (step S536). When the operation input acceptance unit 12 of the terminal 10aa accepts pressing of the update button, the transmission / reception unit 11 receives conference room editing information including conference room ID, conference name, terminal ID, and information indicating addition or deletion of the terminal ID. It transmits to the management system 50 (step S537).

  Next, the conference management unit 59 of the management system 50 receives the conference room editing information via the transmission / reception unit 51. The conference management unit 59 adds or deletes a record in the room entry management DB 5007 according to information indicating addition or deletion of the terminal ID for the combination of the conference room ID and the terminal ID included in the conference room editing information. The conference management unit 59 searches the conference room ID in the conference room management DB 5008 using the conference room ID included in the conference room editing information as a search key, and includes the conference name of the retrieved record in the conference room editing information. The conference name is updated according to the conference name (step S538).

  The conference management unit 59 transmits a conference room information update notification indicating that the update of the conference room information is completed to the terminal 10aa via the transmission / reception unit 51 (step S539). When receiving the conference room information update notification via the transmission / reception unit 11, the display control unit 17 of the terminal 10aa displays an update completion image including information indicating that the conference room has been updated on the terminal 10aa (step S540). .

  Next, processing of the terminal 10 and the management system 50 when starting communication using the conference room will be described. In the embodiment, content data from the terminal 10 that first enters the conference room is distributed to each terminal 10 that subsequently enters the conference room.

  First, a case where a conference name is selected from the conference room list image and the conference room is entered (communication is started using the conference room with the conference name) will be described.

  FIG. 26 is a sequence diagram showing processing when entering a conference room for distribution in step S104 of FIG.

  The operation input receiving unit 12 of the terminal 10ab receives an operation input for selecting a distribution application (step S541). Next, the transmission / reception unit 11 of the terminal 10ab transmits a conference name list acquisition request including the terminal ID “01ab” of the terminal 10ab to the management system 50 (step S542).

  Next, the conference management unit 59 of the management system 50 receives the conference name list acquisition request via the transmission / reception unit 51. The conference management unit 59 acquires the conference room ID and conference room name of the conference room related to the terminal ID “01ab” of the terminal 10ab based on the terminal ID “01ab” of the terminal 10ab included in the conference room list acquisition request. (Step S543). Specifically, the conference management unit 59 first searches the records in the entrance management DB 5007 using the terminal ID “01ab” of the terminal 10ab included in the conference room list acquisition request as a search key, and the conference of the searched records. Acquire the room ID (1 and 2). Next, the conference management unit 59 refers to the conference room management DB 5008 and acquires the conference room names (AA nursery school and BA nursery school) of the conference room ID (1 and 2).

  Next, the conference management unit 59 transmits the conference room list information including the conference room ID and the conference room name acquired in step S543 via the transmission / reception unit 51 to the terminal 10ab (step S544). The display control unit 17 of the terminal 10ab receives the conference room list information via the transmission / reception unit 11. The display control unit 17 of the terminal 10ab displays a conference room list image including the conference room name of the conference room list information on the terminal 10ab (step S545).

  Steps S546 to S550 are the same as steps S526 to S530 in FIG.

  The operation input accepting unit 12 of the terminal 10 (request source terminal) accepts a conference room selection operation input (step S551). Next, the transmission / reception unit 11 of the terminal 10 includes the terminal ID of the requesting terminal that has pressed the room entry button, information “Invite + Room” indicating that a call is to be started by communication for distribution, and the conference room of the conference room The room entry request including the ID is transmitted to the management system 50 (step S552). The conference management unit 59 of the management system 50 receives the room entry request via the transmission / reception unit 51. The conference management unit 59 determines whether a record that matches the combination of the conference room ID and the terminal ID included in the room entry request exists in the room entry management DB 5007 (step S553).

  The conference management unit 59 performs processing according to the determination result of step S253 (step S554). FIG. 27 is a flowchart showing a process according to the result of the room entry determination.

  When there is no record that matches the combination of the conference room ID and the terminal ID included in the room entry request in the room entry management DB 5007 and the result of the room entry determination by the meeting management unit 59 of the management system 50 is not room entry OK (step S554-1). , No), the transmission / reception unit 51 transmits error information indicating that the room cannot be entered to the request source terminal that has transmitted the room entry request (step S554-7).

  A record that matches the combination of the conference room ID and the terminal ID included in the room entry request is in the room entry management DB 5007, and the result of the room entry determination by the conference management unit 59 of the management system 50 is room entry OK (step S554). 1, Yes), the process proceeds to step S554-2.

  The session management unit 57 determines whether communication using the conference room specified by the conference room ID included in the room entry request has already been performed (whether the session has already been established) (step S554-). 2). Specifically, the session management unit 57 searches the conference room management DB 5008 using the conference room ID included in the room entry request as a search key, and whether the session ID is set in the session ID field of the searched record. Determine whether or not. That is, the session management unit 57 determines that a session has already been established when a session ID is set in the session ID field of the retrieved record.

  When the session has already been established (step S554-2, Yes), the session management DB 5005 is searched using the session ID as a search key, and the request included in the room entry request in the destination terminal ID field of the searched record The terminal ID of the original terminal is added, and the operation state associated with the terminal ID included in the room entry request is set to “ON line (during transmission)” in the terminal management DB 5003 (step S554-3), and step S554-6. Proceed to

  The session management unit 57 creates a new session ID and creates a new record in the session management DB 5005 (step S554-4). Note that the specific processing relating to the creation of a new session ID is the same as steps S43 to S45 in FIG. 20, but in step S45, the destination terminal ID field has the same value as the value of the request source terminal ID field. The point to set is different.

  Next, the conference management unit 59 searches the conference room management DB 5008 using the conference room ID included in the room entry request as a search key, and newly creates it in the session ID field of the searched record in step S554-4. A session ID is set (step S554-5).

  Next, the transmission / reception unit 51 transmits the session ID and the relay device connection information (IP address, authentication information, port number, etc. of the relay device 30) to the request source terminal that transmitted the room entry request (step S554-6). . With the above processing, the processing for connecting the request source terminal to the relay device is completed. Next, the request source terminal transmits relay request information to the management system 50, and starts a process of requesting call data relay (see FIG. 23, step S61-1 to step S65-1). Thereby, the request source terminal that has transmitted the entry request by accepting the selection of the conference name included in the conference room list from the user starts communication for distribution using the conference room.

  Next, a process of displaying an image including the destination terminal status list information (destination terminal status list image) on the terminal 10aa will be described with reference to FIGS. In addition, when making a connection request in step S106 of FIG. 14, the processing for acquiring the destination list of FIG. 18C from the management system 50 also acquires the destination list from the management system 50 when the terminal 10 shown below is activated. It is the same as the processing to do.

  FIG. 28 is a diagram illustrating an image including destination terminal state list information. The destination terminal status list image includes destination terminal status information including information indicating the destination terminal associated with the communication request source terminal and information indicating whether the conference room is associated with the destination terminal (image 1500). 6 is an image showing destination terminal state list information including one or more. The destination terminal information including the image 1500 indicates that the communication for distribution (virtual conference room) in which the destination terminal can participate is registered in the management system 50. In the example of the destination terminal status list image of FIG. 28, operating status information (image 1501, image 1502, image 1503, image 1504) indicating the operating status of the destination terminal is also shown. An image 1501 indicates that the destination terminal is “ON line (can call)”. An image 1502 indicates that the destination terminal is “ON line (during a call)”. An image 1503 indicates that the destination terminal is “OFF line”. An image 1504 indicates that the destination terminal is “ON line (during transmission)”.

  In the example of FIG. 28, the destination button 1505 of the terminal (“01e2”, “01e3”) whose operation state is “ON line (during a call)” or “OFF line” is displayed in gray, for example, so that it cannot be pressed. Yes. Thereby, the user can confirm on the screen of the destination list whether or not the destination terminal can receive a call. On the other hand, by pressing a destination button 1505 of a terminal (“01ab”, “01e3”) whose operation state is “ON line (can call)” or “ON line (during transmission)”, a call can be transmitted. FIG. 29 is a sequence diagram illustrating processing for displaying an image including destination terminal state list information on a terminal. In FIG. 29, all communication between the terminal 10 and the management system 50 is performed using the management information session sei.

  First, when the user of the terminal 10aa turns on the power switch 109 shown in FIG. 3, the operation input accepting unit 12 shown in FIG. 5 accepts the power ON and turns on the power (step) S21). The login request unit 13 automatically transmits login request information indicating a login request from the transmission / reception unit 11 to the management system 50 via the communication network 2 in response to the reception of the power ON (step S22). This login request information includes a terminal ID and a password for identifying the terminal 10aa which is the own terminal as a request source. These terminal ID and password are data read from the nonvolatile storage unit 1000 via the storage / reading processing unit 18 and sent to the transmission / reception unit 11. When the login request information is transmitted from the terminal 10aa to the management system 50, the management system 50 that is the receiving side can grasp the IP address of the terminal 10aa that is the transmitting side.

  Next, the terminal authentication unit 52 of the management system 50 uses the terminal ID and password included in the login request information received via the transmission / reception unit 51 as a search key, and the terminal authentication management table (see FIG. 7) and terminal authentication is performed by determining whether or not the terminal authentication management DB 5002 has a terminal ID and password that match the search key (step S23).

  When the terminal ID and password that match the search key are in the terminal authentication management DB 5002, the state management unit 53 searches for the terminal ID in the terminal management table (see FIG. 8) by using the terminal ID of the search key. Set the date and time when login request information was received in the received date and time field of the record. Further, the state management unit 53 stores the IP address included in the login request information in the IP address field of the terminal of the retrieved record (step S24-1). Accordingly, the terminal management table shown in FIG. 8 includes the terminal ID “01aa”, the reception date and time “2009.11.10.13:40” and the terminal IP address “1.2.1.3”. It will be managed in association.

  Subsequently, the state management unit 53 sets the operation state “ON line (call possible)” of the terminal 10aa in the operation state field of the retrieved record (step S24-2). As a result, in the terminal management table shown in FIG. 8, the terminal ID “01aa” is managed in association with the operating state “ON line (call possible)”.

  Then, the transmission / reception unit 51 of the management system 50 sends the authentication result information indicating the authentication result obtained by the terminal authentication unit 52 via the communication network 2 to the request source terminal (terminal 10aa) that made the login request. (Step S25). In the present embodiment, the case where the terminal authentication unit 52 determines that the terminal has a valid usage right will be described below.

  When the terminal 10aa receives the authentication result information indicating that the terminal 10aa is determined to be a terminal having a right to use, it indicates that the transmission / reception unit 11 requests the destination list from the management system 50 via the communication network 2. The destination list request information is transmitted (step S26). Thereby, the transmission / reception unit 51 of the management system 50 receives the destination list request information.

  Next, the terminal extraction unit 54 searches the destination list management table (see FIG. 9) using the terminal ID “01aa” of the request source terminal (terminal 10aa) that requested the login as a search key, and requests the request source terminal (terminal 10aa). It extracts by reading the terminal IDs of candidate destination terminals that can make a call (step S27). Further, the terminal extraction unit 54 searches the terminal management table (see FIG. 8) using the extracted terminal ID as a search key, and extracts the destination name corresponding to the terminal ID by reading it. Here, the terminal IDs (“01ab”, “01e1”, “01e2”) of the destination terminals (10ab, 10e1, 10e2,...) Corresponding to the terminal ID “01aa” of the request source terminal (terminal 10aa), ...) and the corresponding terminal names are extracted.

  Next, the storage / reading processing unit 60 of the management system 50 reads layout information representing the display format of an image showing a list of destination terminals from the non-volatile storage unit 5000 (step S28), and at the same time extracts the layout information and the terminal extraction. "Destination list information (layout information, terminal ID, destination name)" including the terminal ID and destination name extracted by the unit 54 is transmitted to the request source terminal (terminal 10aa) (step S29). Thereby, in the request source terminal (terminal 10aa), the transmission / reception unit 11 receives the destination list information, and the storage / reading processing unit 18 stores the destination list information in the volatile storage unit 1100 (step S30).

  Further, the terminal status acquisition unit 55 of the management system 50 uses the terminal IDs (“01ab”, “01e1”, “01e2”,...) Of the destination terminal candidates extracted by the terminal extraction unit 54 as search keys. The terminal management table (see FIG. 8) is searched, and the corresponding operation state is read out for each terminal ID extracted by the terminal extraction unit 54, so that terminals (10ab, 10e1, 10e2,. (1) is acquired (step S31).

  Next, the transmission / reception unit 51 uses the “multiple session permission flag” information associated with the requesting terminal (terminal 10aa) that requested the login in the terminal management table (see FIG. 8) as a search key in step S31. “Terminal of terminal” including the used terminal ID (“01ab”, “01e1”, “01e2”,...) And the operating state of the corresponding destination terminal (10ab, 10e1, 10e2,...). The “status information” is transmitted to the request source terminal (terminal 10aa) via the communication network 2 (step S32).

  Next, the storage / read processing unit 18 of the request source terminal (terminal 10aa) stores the terminal state information received from the management system 50 in the volatile storage unit 1100 (step S33). As a result, it is possible to acquire the current operating states of the terminal 10 that is a candidate for the destination terminal that can talk to the request source terminal (terminal 10aa).

  Further, the conference management unit 59 of the management system 50 uses the terminal IDs (“01ab”, “01e1”, “01e2”,...) Of the destination terminal candidates extracted by the terminal extraction unit 54 as search keys. The room entry management table (see FIG. 12) is searched, and if there is a conference room ID associated with the terminal ID for each terminal ID extracted by the terminal extraction unit 54, the conference room ID is read (step S34).

  Next, the conference management unit 59 of the management system 50 transmits conference room presence information including the terminal ID and the conference room ID associated with the terminal ID to the terminal 10aa via the transmission / reception unit 51 (step S35). ). Next, the storage / read processing unit 18 of the request source terminal (terminal 10aa) stores the conference room presence information received from the management system 50 via the transmission / reception unit 11 in the volatile storage unit 1100 (step S36). Next, the destination list creation unit 20 of the terminal 10aa creates a destination list (destination terminal status list information) based on the information of “multiple session permission flag”, destination list information, status information, and conference room presence information. Next, the display control unit 17 of the request source terminal (terminal 10aa) displays the destination list on the display 120 shown in FIG. 3 as a destination terminal state list image (see FIG. 28) (step S37).

  Through the above processing, the management system 50 displays an image including the destination terminal state list information of FIG. 28 on the display 120aa of the terminal 10aa. In the destination terminal state list image of this embodiment, information indicating whether or not there is a conference room associated with the destination terminal is expressed by the presence or absence (image 1504) of the conference room icon displayed for each destination terminal state information. .

  Next, the processing in the case of requesting the start of a call session during distribution in step S106 of FIG. 14 will be described using FIG. FIG. 30 is a sequence diagram illustrating processing for requesting the start of a call. In FIG. 30, all communication between the terminal 10 and the management system 50 is performed using the management information session sei. Further, in the present embodiment, the request source terminal (terminal 10aa) has an operation state of “ON line (can call)” among the terminals 10 as the destination candidates shown in the destination terminal list image (see FIG. 28). "Or" ON line (during transmission) "can be requested to start communication with at least one of the terminals.

  First, when the user of the request source terminal (terminal 10aa) presses the operation button 108 shown in FIG. 3 to select the destination terminal (terminal 10ab), the operation input receiving unit 12 shown in FIG. Then, a request for starting a call with the terminal 10ab is accepted (step S41). Then, the transmitting / receiving unit 11 of the terminal 10aa requests the terminal ID “01aa” of the request source terminal (terminal 10aa), the terminal ID “01ab” of the destination terminal (terminal 10ab), and the start of a call by communication for calling. Is transmitted to the management system 50 (step S42). Thereby, the transmission / reception unit 51 of the management system 50 receives the start request information and grasps the IP address “1.2.1.3” of the request source terminal (terminal 10aa) that is the transmission source. .

  Next, the session ID generation unit 56a identifies the communication (call data (image / audio data) session sed) with each destination terminal requested by the request source terminal (terminal 10aa). se2 "is generated (step S43). When the session ID is generated, the session management unit 57 stores the session ID “se2” and the number of destination terminals “2” in the volatile storage unit 5100. This number of destination terminals is used to determine whether or not the change request information “Reject” has been received from all of the destination terminals when the change request information “Reject” for refusing the start of communication is received later. Used for.

  Subsequently, the relay device selection unit 56 of the management system 50 relays a call between the request source terminal (terminal 10aa) and the destination terminal (terminal 10ab) based on the relay device management DB 5001 and the relay device selection management DB 5006. The relay device 30 is selected (step S44). In this case, first, the relay device extraction unit 56b receives the terminal ID “01aa” of the request source terminal (terminal 10aa) included in the start communication information transmitted from the request source terminal (10aa), the destination terminal (terminal 10ab). ), The relay device ID (“111a”, “111a”) corresponding to the terminal (10aa, 10ab) is extracted by searching the relay device selection management table (see FIG. 11) based on the terminal ID “01ab”. To do.

  If all the extracted relay device IDs are the same, the selection unit 56c operates the extracted relay device ID among the operation states of the relay device 30 managed in the relay device management table (see FIG. 6). Refer to the state. Here, when the operating state of the relay device ID is “ON line”, the selection unit 56c selects the extracted relay device as a relay device for relaying a call. If the extracted relay device IDs are not the same, or if the operation status of the relay device ID is “OFF line” as a result of the above reference, the relay device 30e with the relay device ID “111e” is called As a relay device for relaying In the present embodiment, the case where the relay device 30e is selected will be described below.

  When the selection process of the relay device 30 is completed, the session management unit 57, in the session management table (see FIG. 10) of the nonvolatile storage unit 5000, the request source terminal ID and the destination terminal ID of the record including the session ID “se2”. The terminal ID “01aa” of the request source terminal (terminal 10aa), the terminal ID “01ab” of the destination terminal (terminal 10ab), and the relay device ID “111e” of the selected relay device 30e are included in the field portion of the relay device ID. Store and manage (step S45).

  Next, the transmission / reception unit 51 illustrated in FIG. 5 is selected by the selection unit 56c and the session ID generated by the session ID generation unit 56a to the request source terminal (terminal 10aa) via the communication network 2. The relay device connection information used for connecting to the relay device 30e is transmitted (step S46). The relay device connection information can include the IP address “1.1.1.3” of the relay device 30e, authentication information, a port number, and the like. Thereby, the terminal 10aa can grasp the relay device connection information used to connect to the relay device 30e used for relaying the call data in the execution of the session with the session ID “se2”.

  Next, the transmission / reception unit 51 includes the terminal ID “01aa” of the request source terminal (terminal 10aa), change request information “Invite” indicating that a start of a call with the destination terminal is requested, and a session ID “se2”. The start request information, the relay device connection information used to connect to the relay device 30e, and the IP address of the management system 50 are transmitted to all destination terminals (10ab) (step S47). As a result, the transmission / reception unit 51 of the destination terminal (terminal 10ab) receives the start request information, and at the transmission device connection information and the transmission source used to connect to the relay device 30e used for relaying call data. The IP address “1.1.1.2” of a certain management system 50 is grasped.

  Subsequently, referring to FIG. 31, the user of the destination terminal (terminal 10ab) that has received the start request information presses the operation button 108 shown in FIG. ) Will be described in the case where a response indicating that the start of communication with the device is permitted is received. FIG. 31 is a sequence diagram illustrating processing for permitting a request to start communication. A response to permit the start of communication with the request source terminal (terminal 10aa) is accepted by the operation button 108 of the destination terminal (terminal 10ab) (step S48). Next, the transmission / reception unit 11 of the destination terminal (terminal 10ab) accepts the terminal ID “01ab” of the destination terminal (terminal 10ab), the terminal ID “01aa” of the requesting terminal (terminal 10aa), and permission to start communication. The start response information including the indicated information “Accept” and the session ID “se2” is transmitted to the management system 50 (step S49).

  When the transmission / reception unit 51 of the management system 50 receives the start response information, the state management unit 53 is based on the terminal ID “01aa” of the request source terminal (terminal 10aa) and the terminal ID “01ab” of the destination terminal (terminal 10ab). In the terminal management table (see FIG. 8), the field portion of the operation state of the record including the terminal ID “01aa” and the terminal ID “01ab” is changed to “ON line (during a call)” (step S50). ).

  Next, the transmission / reception unit 51 includes a terminal ID “01ab” of the destination terminal (terminal 10ab), change request information “Accept” indicating that a request to start a call with the destination terminal is permitted, and a session ID “se2”. Start response information is transmitted to the request source terminal (terminal 10aa) (step S51). Upon receiving this start response information, the request source terminal (terminal 10aa) transmits the session ID “se2” and the relay device connection information acquired in step S46 to the relay device 30e by the transmission / reception unit 11, thereby the relay device 30e is connected (step S52). On the other hand, the destination terminal (terminal 10ab) connects the relay device 30e by transmitting the session ID “se2” and the relay device connection information acquired in step S47-2 to the relay device 30e by the transmission / reception unit 11 ( Step S53).

  Subsequently, referring to FIG. 32, when the user of the destination terminal (terminal 10ab) that received the start request information in step S47 presses the operation button 108 shown in FIG. 3, the request source terminal (terminal 10aa) is displayed. ) Will be described in the case where a response to reject the start of communication is received. FIG. 32 is a sequence diagram illustrating processing for rejecting a request to start communication. When a response to reject the start of communication with the request source terminal (terminal 10aa) is received by the operation button 108 of the destination terminal (terminal 10ab) (step S54), the transmission / reception unit of the destination terminal (terminal 10ab) 11, the management system 50 includes start response information including the terminal ID “01ab” of the destination terminal (terminal 10ab), change request information “Reject” indicating that the communication start request is rejected, and session ID “se2”. (Step S55).

  Next, the session management unit 57 determines the terminal ID of the destination terminal (terminal 10ab) from the field part of the destination terminal of the record including the session ID “se2” in the session management table (see FIG. 10) of the nonvolatile storage unit 5000. “01ab” is deleted (step S56). Further, the transmission / reception unit 51 receives start response information including the terminal ID “01ab” of the destination terminal (terminal 10ab), response information “Reject” indicating that the request to start communication is rejected, and the session ID “se2”. Transmit to the request source terminal (terminal 10aa) (step S57). Thereby, the request source terminal (terminal 10aa) grasps that the request for starting communication with the request source terminal (terminal 10bb) has been rejected.

  Subsequently, using FIG. 33, when a call data session is connected as shown in FIG. 31, the relay device 30e is communicated between the request source terminal (terminal 10aa) and the destination terminal (terminal 10ab). A process for starting relaying call data will be described. In FIG. 33, all communication until the establishment of the image / audio communication session is performed using the management information session sei.

  First, the request source terminal (terminal 10aa) is connected to the relay device 30e (see step S52) at a predetermined timing by the transmitter / receiver 11 by the terminal ID “01aa” and session ID of the request source terminal (terminal 10aa). Relay request information including “se2” and information “Join” indicating that the start of relay is requested is transmitted to the management system 50 (step S61-1).

  When the transmission / reception unit 51 of the management system 50 receives the relay request information, connection control for establishing communication is executed. First, the management system 50 transmits relay start request information including the terminal ID “01aa” of the request source terminal (terminal 10aa) and the session ID “se2” to the relay device 30e (step S62-1). When this relay start request information is received, the relay device 30e transmits relay start permission information including notification information “OK” indicating that the start of relay is permitted to the management system 50 (step S63-1). Upon receiving this response, the transmission / reception unit 51 of the management system 50 transmits this relay start permission information to the request source terminal (terminal 10aa) (step S64-1). Thereby, the call data session sed between the request source terminal (terminal 10aa) and the relay device 30a is established (step S65-1).

  On the other hand, the destination terminal (terminal 10ab) is connected to the relay device 30e (see step S53), and the transmission / reception unit 11 causes the terminal ID “01ab” and the session ID “se2” of the destination terminal (terminal 10ab) to be transmitted and received. ”And relay request information including information“ Join ”indicating that the start of relay is requested is transmitted to the management system 50 (step S61-2).

  Subsequently, the management system 50 and the relay device 30e execute processing similar to steps S62-1, S63-1, and S64-1, so that the call data between the destination terminal (terminal 10ab) and the relay device 30e is obtained. Session sed is established (steps S62-2, S63-2, S64-2, S65-2). When the call data session sed between the request source terminal (terminal 10aa) and the relay device 30e and the call data session sed between the destination terminal (terminal 10aa) and the relay device 30e are established, the relay device 30a The three image data of low resolution, medium resolution, and high resolution, and audio data can be relayed between the terminals (10aa, 10ab). Thereby, terminal (10aa, 10ab) can start a video conference.

  Next, referring to FIG. 34, after a call data session is established between the request source terminal (terminal 10aa) and the destination terminal (terminal 10ab) in step S121 of FIG. 14, the request source terminal (terminal 10aa) is established. ) Will be described for the process of leaving (disconnecting) from this call data session. The process for exiting the conference room for distribution is the same as the following.

  FIG. 34 is a sequence diagram showing processing for requesting exit from the call data session. Note that all communication in the sequence diagram of FIG. 34 is performed using the management information session sei.

  First, when the user of the request source terminal (terminal 10aa) presses the operation button 108 shown in FIG. 3, a request to leave the call data session is accepted (step S111). Then, the transmission / reception unit 11 of the request source terminal (terminal 10aa) includes the terminal ID “01aa” of the request source terminal (terminal 10aa), change request information “Leave” indicating a request to leave the call data session, and the session ID “ Session exit request information including “se2” is transmitted to the management system 50 (step S112).

  Next, in the session management table (see FIG. 10) of the non-volatile storage unit 5000, the session management unit 57 determines the request source terminal (terminal 10aa) from the field portion of the request source terminal of the record including the session ID “se2”. The terminal ID “01aa” is deleted (step S113). The management system 50 transmits, to the relay device 30e, a notification to request exit of the session including the terminal ID “01aa” and the session ID “se2” of the request source terminal (terminal 10aa) (step S114). Thereby, the relay device 30e stops the call data session with the request source terminal (terminal 10aa) and disconnects the connection with the request source terminal (terminal 10aa). Subsequently, the relay device 30e transmits to the management system 50 a notification that the request for leaving including the terminal ID “01aa” and the session ID “se2” of the request source terminal (terminal 10aa) is permitted (step S115). ).

  When the management system 50 receives a notification that the request for leaving is permitted, the transmission / reception unit 51 receives the terminal ID “01aa”, the change request information “Leave”, the session ID “se2” of the request source terminal (terminal 10aa), the leaving Session exit permission information including notification information “OK” indicating that the request is permitted is transmitted to the request source terminal (terminal 10aa) (step S116). Based on the terminal ID “01aa” of the request source terminal (terminal 10aa) included in the session exit request information, the state management unit 53 of the management system 50 uses the terminal ID “01aa” in the terminal management table (see FIG. 8). The operating state of the included record is changed from “ON line (during call)” to “ON line (call available)” (step S117).

  Next, the terminal 10aa accepts a power-off request by pressing the power switch 109 shown in FIG. 3 (step S118). When a request to turn off the power is received, the transmission / reception unit 11 transmits to the management system 50 disconnection request information including notification information for disconnecting the connection between the terminal ID “01aa” of the terminal 10aa and the management system 50 ( Step S119).

  When the transmission / reception unit 51 of the management system 50 receives the disconnection request information, the state management unit 53 receives the terminal management table (FIG. 8) based on the terminal ID “01aa” of the request source terminal (terminal 10aa) included in the disconnection request information. In step S120, the operating state of the record including the terminal ID “01aa” is changed from “ON line (call possible)” to “OFF line”. Subsequently, the transmission / reception unit 51 transmits disconnection permission information for permitting a disconnection request to the request source terminal (terminal 10aa) (step S121). As a result, the management system 50 stops the management data session with the request source terminal (terminal 10aa) and disconnects the connection with the request source terminal (terminal 10aa).

  When receiving the disconnection permission information, the request source terminal (terminal 10aa) turns off the power and completes the process (step S122).

<Effect>
As described above, according to this embodiment, it is possible to perform private communication with a terminal while continuing to distribute content data to a plurality of terminals. In addition, the management system 50 can manage whether or not a plurality of sessions can be connected in parallel.

For example, if you use a terminal that distributes nursery school videos, etc., if you contact a child's guardian about a child's sudden fever, the other guardian will hear the voice, etc. is there. According to the present embodiment, when a call session is connected, the delivery sound is stopped (muted), so that privacy can be protected.
[Second Embodiment]
In the first embodiment, when the terminal 10 establishes the first session while the second session is established (connected), the transmission of the audio data in the second session is stopped. Thus, the example of changing the quality of content data communication in the second session has been described.

  In the second embodiment, instead of or in addition to the first embodiment, when the terminal 10 establishes the first session while the second session is established, the terminal 10 communicates with the relay device 30. An example in which the quality of the communication band of content data communication in the second session is changed based on the communication band between will be described.

  FIG. 35 is a functional block diagram of each terminal, device, and system constituting the transmission system according to the second embodiment. Compared with the functional block diagram of the first embodiment in FIG.

<Functional configuration of management system>
The management system 50 further includes a quality setting management DB 5009.

(Quality setting management table)
In the nonvolatile storage unit 5000, a quality setting management DB 5009 configured by a quality setting management table as shown in FIG. 36 is constructed. In this quality setting management table, for each terminal ID of the terminal 10, the ratio of the communication band corresponding to the communication of each content data in each session and the minimum communication band setting corresponding to the communication of each content data in each session Are associated and managed. For example, in the quality setting management table shown in FIG. 36, the terminal 10 whose terminal ID is “01aa” communicates content data “video transmission” in the “distribution” session, and “ The ratio of the communication bandwidth to the content data communication of “video transmission” and “video reception” is 3: 6: 1, respectively, and the minimum is the minimum for content data communication of “video transmission” in the “call” session. It is shown that the communication band is set to “512 kbps”.

  Next, a functional block diagram of the management system 50 will be described.

  In response to a request from the terminal 10, the transmission / reception unit 51 of the management system 50 responds to the terminal ID of the terminal 10, the proportion of the communication band according to the communication of each content data in each session, and each content in each session Quality setting information including a minimum communication band corresponding to data communication is acquired from the quality setting management table. The transmission / reception unit 51 notifies the terminal 10 of the acquired quality setting information.

<Functional configuration of terminal>
Next, the terminal 10 will be described. The terminal 10 further includes a band information acquisition unit 21 and a quality determination unit 22.

  When the bandwidth information acquisition unit 21 establishes the first session with the first terminal when the second session with the second terminal is established, the bandwidth information acquisition unit 21 communicates with the relay device. Band information acquisition processing for acquiring communication band information is performed. The bandwidth information acquisition unit 21 performs bandwidth information acquisition processing, for example, periodically while the establishment of the first session and the second session is continued. The details of the bandwidth information acquisition process will be described later.

  The quality determination unit 22 acquires quality setting information managed in the quality setting management table in association with the terminal ID of the terminal 10 from the management system 50 via the transmission / reception unit 11. The quality setting information may be stored in advance in the terminal 10.

  When the bandwidth information acquisition unit 21 acquires the information of the communication band with the relay device, the quality determination unit 22 determines the communication quality of the content data in each session based on the communication band information and the quality setting information. Determine the quality decision process. Details of the quality determination process will be described later.

  The session control unit 19 is determined by the quality determination unit 22 when establishing the first session with the first terminal when the second session with the second terminal is established. The communication quality of content data in each session is changed based on the communication quality. Note that the communication quality of content data in each session relates to the communication bandwidth of content data, and “quality” includes, for example, video resolution, frame rate, and the like.

  When the first session with the first terminal or the second session with the second terminal is disconnected, the session control unit 19 sets the communication quality of content data in each session to normal Return to the state.

  The session control unit 19 uses the transmission / reception unit 11 to perform content data communication according to the quality of content data communication in each session determined by the quality determination unit 22.

<< Process or Operation of Second Embodiment >>
Subsequently, a processing method in the transmission system 1 according to the second embodiment will be described with reference to FIGS. 37 to 34.

  First, with reference to FIG. 37, the operation of the transmission system 1 when performing communication band control processing in the second embodiment will be described. FIG. 37 is a sequence diagram illustrating an example of processing when performing communication band control processing.

  The terminal 10-1 distributes content data such as images and sounds using a distribution session (step S1101).

  The relay device 30 transfers the content data to the distribution destination terminals 10-2 and 10-3 (steps S1102-1 and S1102-2).

  The terminal 10-1 specifies a destination from the user and receives a request for starting a session for a call (step S1103).

  The terminal 10-1 performs a band information acquisition process for acquiring information on an available communication band with the relay device 30 (step S1104).

  The terminal 10-1 requests the management system 50 to notify the content data quality setting information in the distribution session and the call session (step S1105).

  The management system 50 notifies the terminal 10-1 of content data quality setting information in the distribution session and the call session (step S1106).

  The terminal 10-1 performs a quality determination process for determining the quality of content data communication based on the setting information notified from the management system 50 (step S1107).

  The terminal 10-1 changes the quality of communication of the content data in the distribution session (step S1108).

  The relay device 30 transfers the content data including the changed quality image data to the distribution destination terminals 10-2 and 10-3 (steps S1109-1 and S1109-2).

  The terminal 10-1 transmits a call session start request to the destination terminal 10-2 via the management system 50 (step S1110).

  The terminal 10-1 receives the response from the destination terminal 10-2 via the management system 50 (step S1111).

  The terminal 10-1 transmits the video for transmission in the call session with the determined quality via the relay device 30 (step S1112).

  The terminal 10-1 changes the quality of the received video in the call session to the determined quality (step S1113).

  Note that the processing for changing the quality of communication of content data in the distribution session in step S1108 may be performed after receiving a response from the destination terminal 10-2 in step S1111.

  In addition, the process which changes the quality of the image | video for reception in step S1113 to the determined quality is good also as a structure performed as follows, for example. The terminal 10-1 transmits a predetermined command to the destination terminal 10-2 or the relay device 30. The destination terminal 10-2 or the relay device 30 that has received the command controls the quality of the video from the destination terminal 10-2 to a quality according to the command. Alternatively, when the relay device 30 has a function of controlling the quality of the video from the destination terminal 10-2 based on the delay time notified from the terminal 10-1, the terminal 10-1 changes to the relay device 30. By notifying the predetermined delay time, the relay device 30 may be configured to control the quality of the video from the destination terminal 10-2.

  Next, with reference to FIG. 38, a detailed example of the band information acquisition process in step S1103 of FIG. 37 by the band information acquisition unit 21 of the terminal 10-1 will be described. FIG. 38 is a flowchart illustrating an example of bandwidth information acquisition processing.

  The bandwidth information acquisition unit 21 transmits data (transmission data) of a predetermined size to the relay device 30 using, for example, a well-known Ping (step S1201).

  The band information acquisition unit 21 receives a response to the transmission data from the transmission / reception unit 31 of the relay device 30 (step S1202).

  The bandwidth information acquisition unit 21 measures an elapsed time (round trip time) from when transmission data is transmitted until a response is received (step S1203).

  Based on the size of the transmission data, the size of the response data, and the elapsed time, the bandwidth information acquisition unit 21 estimates the communication bandwidth between the terminal 10-1 and the relay device 30 using, for example, the following equation (step S1204). .

Communication band = (size of transmission data + size of reception data) × coefficient α / elapsed time Note that when Ping is used, the size of reception data is the same as the size of transmission data. Here, the coefficient α is a coefficient set in advance in consideration of fluctuations in the communication network, errors in estimated values, and the like. The information on the coefficient α may be acquired from the management system 50 or may be stored in advance in the terminal 10-1.

  Note that the communication band may be calculated using, for example, a table of estimated communication band values for each elapsed time instead of calculating based on the above formula. Further, as a method for estimating the communication band, a configuration using another known method may be used. For example, transmission data of a predetermined size is transmitted from the terminal 10-1 to the relay apparatus 30 using TCP, RTP, or the like, and the reception confirmation is notified from the relay apparatus 30 to the terminal 10-1. The terminal 10-1 may be configured to estimate the communication band by dividing the size of the transmission data by the elapsed time from transmission data transmission to reception confirmation reception and multiplying by a predetermined coefficient. Good.

  The band information acquisition unit 21 may be configured to acquire communication band information stored in advance in the terminal 10 instead of acquiring communication band information by measurement, or from the management system 50. It is good also as a structure which acquires information.

  Next, with reference to FIG. 39, the detailed example of the quality determination process of FIG.36 S1106 by the quality determination part 22 of the terminal 10-1 is demonstrated. FIG. 39 is a flowchart illustrating an example of the quality determination process.

  Based on the communication band measured by the band information acquisition unit 21 and the ratio of the content data communication in each session acquired from the management system 50, the quality determination unit 22 determines the communication band of the content data communication in each session. Calculate (step S1301).

  The quality determination unit 22 determines whether content data communication acquired from the management system 50 out of the content data communication in each session is not more than the minimum communication band for the content data communication in each session (step S1302).

  If there is no content data communication not exceeding the minimum communication band for content data communication in each session (NO in step S1302), the process ends.

  If there is content data communication not exceeding the minimum communication bandwidth for content data communication in each session (YES in step S1302), the communication bandwidth allocated to the content data communication is determined as the minimum communication bandwidth for the content data communication. (Step S1303).

  Based on the ratio of content data communication in each session other than the already determined one or more content data communications acquired from the management system 50, the communication bandwidth of content data communication in each session is calculated (step S1304). ).

  Regarding the communication of the content data in each session, the process returns to the processing after step S1302.

  In the example of the quality setting management table of FIG. 36, when the communication band with the relay device 30 acquired by the band information acquisition unit 21 is 1 Mbps (1024 kbps), “video transmission” in the “distribution” session is set. The assigned transmission band is 1024 × 3 / (3 + 6 + 1) = 307 kbps. Similarly, the transmission band allocated to “video transmission” in the “call” session is 1024 × 6 / (3 + 6 + 1) = 614 kbps.

  When the communication band with the relay device 30 acquired by the band information acquisition unit 21 is 0.6 Mbps (614 kbps), the transmission band allocated to “video transmission” in the “call” session is at least It is “512 kbps” set as the communication band. In this case, the transmission band allocated to “video transmission” in the “distribution” session is (614-512) × 3 / (3 + 1) = 77 kbps.

  Next, an example of a display screen at the distribution destination when the communication band for video distribution is equal to or less than a predetermined threshold will be described with reference to FIG.

  When the transmission band allocated to “video transmission” in the “distribution” session is equal to or less than the first threshold, the session control unit 19 transmits a predetermined command to the distribution destination terminal 10, for example, as shown in FIG. As described above, the image delivered last is displayed as it is on the delivery destination terminal 10 as a single picture.

  When the transmission band allocated to “video transmission” in the “distribution” session is equal to or smaller than the second threshold, the session control unit 19 transmits a predetermined command to the terminal 10 as the distribution destination, for example, as shown in FIG. For example, a message such as “Please wait for a while” is displayed on the terminal 10 of the distribution destination on a gray screen, for example.

  The session control unit 19 uses the minimum communication of “video transmission” in the “call” session in which the communication band with the relay device 30 acquired by the band information acquisition unit 21 is set in the quality setting management table. If the bandwidth is equal to or less than the bandwidth, the value of the acquired entire communication bandwidth is assigned to “video transmission” in the session of “call”, for example, a predetermined command is transmitted to the terminal 10 of the distribution destination, for example, on a gray screen, A message such as “Please wait for a while” is displayed on the terminal 10 of the distribution destination.

<Effect>
When a plurality of sessions are connected at the same time, depending on the network conditions, for example, a communication band is consumed by a distribution session, so that a problem arises in that the communication band for a call session is insufficient and video quality is lowered.

  For example, when using a terminal that distributes nursery school images, etc., to notify the child's guardian about the sudden fever, etc., the image transmitted in the call session will convey the child's facial expression in detail. It is considered that the quality that can be obtained is desirable. On the other hand, since the video to be distributed only needs to know the state of the distribution side, it is considered that the necessity for constantly transmitting high-quality video is low.

  According to the present embodiment, the quality of the video of the priority session can be ensured by automatically determining the priority session and controlling the bandwidth of other sessions. As a result, during the time until the call is terminated, the consumption of communication bandwidth due to the video transmitted in the video session is suppressed, and the quality of the video transmitted in the session for high priority, for example, is ensured. Can do.

<< Supplement of Embodiment >>
The destination list creation unit 20 that creates the destination terminal state list image of the destination list may be configured to be provided in the management system 50 instead of the configuration provided in the terminal 10. In this case, when the operation state of the terminal 10 is “ON line (during transmission)” or “ON line (during a call)”, it is determined that the terminal 10 is connected to a distribution session or a call session. It is good also as composition to do. Thereby, processing for displaying the destination list on the terminal 10 side can be reduced.

  Further, the management system 50 and the program providing system 90 in each of the above embodiments may be constructed by a single computer, or may be constructed by a plurality of computers arbitrarily assigned by dividing each unit (function or means). May be. In addition, when the program providing system 90 is constructed by a single computer, the program transmitted by the program providing system 90 may be transmitted by dividing it into a plurality of modules. It may be transmitted. Further, when the program providing system 90 is constructed by a plurality of computers, a plurality of modules may be divided and transmitted from each computer.

  Further, the terminal program, the relay device program, and the transmission management program of the present embodiment, the HD 204 storing the program, and the program providing system 90 including the HD 204 are as follows: Both are used when the terminal program, the relay device program, and the transmission management program are provided to a user or the like as a program product (program product) in Japan or abroad.

  In the present embodiment, “video conference” is used as a term that can be replaced with “video conference”.

  In the above embodiment, a video conference system has been described as an example of the transmission system 1. However, the present invention is not limited to this, and may be a telephone system such as an IP (Internet Protocol) telephone or an Internet telephone. . Further, the transmission system 1 may be a car navigation system. In this case, for example, one of the terminals 10 corresponds to a car navigation device mounted on a car, and the other of the terminals 10 is mounted on a management terminal or management server of a management center that manages car navigation, or another car. This corresponds to a car navigation device. Furthermore, the transmission system 1 may be an audio conference system or a PC (Personal Computer) screen sharing system.

  Further, in the above embodiment, the case where a video conference is performed by the transmission system 1 has been described. However, the present invention is not limited to this, and a general conversation such as a meeting, a family or a friend, or information in one direction is performed. It may be used for presentation.

  Moreover, although the said embodiment demonstrated the case where the terminal 10 was a dedicated terminal as is shown by FIG. 2, the terminal 10 may be general purpose terminals, such as a smart phone and PC. That is, the above-described terminal program may be installed and executed on a general-purpose terminal such as a smartphone or a PC.

10 Terminal 11 Transmission / reception unit (an example of “communication unit”)
12 operation input reception unit 13 login request unit 14a imaging unit 14b imaging unit 15a audio input unit 15b audio input unit 16a audio output unit 16b audio output unit 17 display control unit 18 storage / read processing unit 19 session control unit 20 destination list creation unit 21 Band information acquisition unit 22 Quality determination unit 30 Relay device 31 Transmission / reception unit 32 State detection unit 33 Storage / read processing unit 50 Management system 51 Transmission / reception unit (an example of “reception unit”)
52 Terminal Authentication Unit 53 Status Management Unit 54 Terminal Extraction Unit 55 Terminal Status Acquisition Unit 56 Relay Device Selection Unit 57 Session Management Unit 58 Session Control Unit 59 Conference Management Unit 60 Storage / Read Processing Unit 1000 Nonvolatile Storage Unit 1100 Volatile Storage Unit 3000 Nonvolatile storage unit 5000 Nonvolatile storage unit 5001 Relay device management DB
5002 Terminal authentication management DB
5003 Terminal management DB (an example of a “terminal management unit”)
5004 Destination list management DB
5005 Session management DB
5006 Relay device selection management DB
5007 Entrance Management DB
5008 Conference room management DB
5009 Quality setting management DB
5100 Volatile memory

JP 2005-293065 A

Claims (13)

A receiving unit that receives a request that is a request to establish a first session between a first terminal and a second terminal and that is transmitted by the first terminal;
When the second session different from the first session is established between the first terminal and the third terminal, the receiving unit receives a request to establish the first session A session control unit that transmits a request to establish the first session to the second terminal;
A management system comprising: The session control unit sends the first session to the second terminal based on information indicating whether the first terminal can simultaneously establish the first session and the second session. Determine whether to send a request to establish,
The management system according to claim 1. When the session control unit receives a request to establish the first session, the session control unit causes the second terminal to leave the second session and then establishes the first session to the second terminal. Send a request to
The management system according to claim 1 or 2. The session control unit, when establishing the first session when the second session is established, stops the delivery of audio data from the first terminal in the second session,
The management system according to any one of claims 1 to 3. When the session control unit stops the delivery of the audio data, the session control unit notifies the third terminal that the delivery of the audio data is stopped.
The management system according to claim 4. When establishing the first session with the first terminal when the second session with the second terminal is established, the communication quality of the content data in the second session is A session control unit to be changed;
A communication unit that performs communication of content data in the second session according to the changed communication quality;
A transmission terminal comprising: The first session is a session for making a call with the first terminal;
The second session is a session for delivering content data including audio data with the second terminal,
The session control unit changes the quality of communication of content data in the second session by stopping delivery of the audio data to the communication unit.
The transmission terminal according to claim 6. The session control unit records content data when the first session cannot be established,
The communication unit transmits the recorded content data.
The transmission terminal according to claim 7. A bandwidth information acquisition unit that acquires information of a communication bandwidth between a relay device that relays content data in the first session and the second session;
A quality determining unit that determines communication quality of the first session and the second session based on the acquired communication band information;
The session control unit changes the communication quality of content data in the second session based on the determined communication quality.
The transmission terminal according to any one of claims 6 to 8. The quality determination unit determines the communication quality of each content data based on a communication bandwidth ratio corresponding to each content data communication or a minimum communication bandwidth corresponding to each content data communication. ,
The transmission terminal according to claim 9.   When establishing a first session for making a call with another terminal when a second session to which content data from another terminal is distributed is established, after leaving the second session, A transmission terminal that establishes a first session. Management system
Receiving a request for establishing a first session between a first terminal and a second terminal and transmitted by the first terminal;
When a request for establishing the first session is received when a second session different from the first session is established between the first terminal and the third terminal, the first terminal Sending a request to establish a first session to the two terminals;
The transmission management method that executes. In the management system,
Receiving a request for establishing a first session between a first terminal and a second terminal and transmitted by the first terminal;
When a request for establishing the first session is received when a second session different from the first session is established between the first terminal and the third terminal, the first terminal Sending a request to establish a first session to the two terminals;
A program that executes

Images