JP2020025293A - Message control system, communication system, program, and maintenance system - Google Patents

Abstract

To solve such a problem that a user is confused whether or not to wait for communication start processing, when the user cannot understand a possible cause of impossible to acquire the operating state of a communication terminal on the destination side, on the own communication terminal side.SOLUTION: When a communication system used by a destination terminal (01da) is not a communication system used by a request source terminal, a message control system transmits operating state information indicating the fact that the operating state of the destination terminal is unknown, or different communication system information indicating the fact that the communication system used by the destination terminal is not the communication system used by the request source terminal, to the request source terminal. Since the user on the request source terminal side can understand the fact that the operating state of the destination terminal cannot be acquired because the communication system of the destination terminal is different, the problem that a user is confused whether or not to wait for communication start processing can be resolved.SELECTED DRAWING: Figure 21

Description

  The present invention relates to an invention for managing first and second communication terminals that transmit and receive predetermined communication data.

  2. Description of the Related Art In recent years, a telephone system for performing a video conference or the like via a communication network such as the Internet has become widespread due to a demand for reducing travel expenses and travel time. In such a call system, a video conference can be realized by transmitting and receiving image data and sound data between a plurality of call terminals (see Patent Document 1).

  In addition, before the user performs a call start process, it is possible to grasp the operating state of the call terminal on the destination side (see Patent Document 2). As a result, after the user performs the call start processing, the call terminal on the destination side is in a call or is in a power-off state, so that the user cannot talk with the call terminal on the destination side, and the call start processing is not performed. It is possible to avoid the state of being wasted.

  However, conventionally, when a call is started between call terminals having different call methods, the user cannot grasp the operating state of the call terminal on the destination side before starting the call. Therefore, the reason that the user cannot obtain the operating state of the destination-side calling terminal on his / her own calling terminal side is that despite the fact that his / her own calling terminal uses the same communication method as the destination-side calling terminal, It is impossible to know whether the destination-side communication terminal is busy, is in a power-off state, or the like, or whether the communication method of the own-side communication terminal is different from the communication method of the destination-side communication terminal.

  For example, if the calling terminal of the destination uses a communication method the same as that of the calling terminal on the destination side, but the calling terminal on the destination side is in a call or is in a power-off state, the user may be notified of the destination. Let's wait for the call start process until the operating state of the call terminal on the side can be acquired. On the other hand, if the call method of the own call terminal is different from the communication method of the call terminal on the destination side, the user cannot start the call process because the operation state of the call terminal on the destination side cannot be acquired no matter how long. I want to go immediately.

  Therefore, if the user cannot grasp the cause of the inability to obtain the operating state of the destination-side calling terminal on his / her own calling terminal side, the user is confused as to whether to wait for or start the call start processing. Challenges had arisen.

  The invention according to claim 1 is a communication management system that manages a plurality of communication terminals that transmit and receive predetermined communication data, wherein each identification information for identifying each of the plurality of communication terminals is used by each of the communication terminals. Terminal information management means for managing communication method information indicating a communication method to be performed, and, for each piece of identification information for identifying a requesting terminal requesting the start of communication among the plurality of communication terminals, the requesting terminal is Destination list management means for managing identification information for identifying a communicable destination terminal; receiving means for receiving, from the requesting terminal, identification information of the requesting terminal; and identification of the received requesting terminal. By searching the destination list management means based on the information, the identification information of the corresponding destination terminal is extracted, and based on the identification information of the extracted destination terminal, Extracting means for extracting corresponding communication method information by searching the terminal information management means; and determining whether the communication method indicated by the extracted communication method information is a communication method used by the requesting terminal. Determining means for determining whether the communication method is not the communication method used by the requesting terminal, the identification information of the extracted destination terminal to the requesting terminal, and the destination Transmission means for transmitting operation state information indicating that the operation state of the terminal is unknown or different communication method information indicating that the communication method is not the communication method used by the request source terminal. System.

  As described above, according to the present invention, when the communication method used by the destination terminal is not the communication method used by the requesting terminal, the communication management system sends the requesting terminal an operation of the destination terminal. Operation state information indicating that the state is unknown, or different communication method information indicating that the communication method used by the destination terminal is not the communication method used by the request source terminal is transmitted. This allows the user of the requesting terminal to know that the operating status of the destination terminal cannot be acquired because the communication method of the destination terminal is different, so it is confusing as to whether to wait for or start communication start processing. Can be solved.

It is a schematic diagram of the telephone system concerning one embodiment of the present invention. It is a conceptual diagram showing the communication situation at the time of realizing a telephone call between telephone terminals of the same communication system. FIG. 5 is a conceptual diagram showing the image quality of image data transmitted and received according to the SVC standard in FIGS. 2 and 4. FIG. 3 is a conceptual diagram showing a communication situation when a call is realized between call terminals of different communication systems. FIG. 5 is a conceptual diagram illustrating image quality of image data transmitted and received according to the AVC standard in FIG. 4. It is an external view of the telephone terminal concerning this embodiment. FIG. 3 is a hardware configuration diagram of the call terminal according to the embodiment. FIG. 2 is a hardware configuration diagram of a call management system, a relay device, a conversion system, a program providing system, or a maintenance system according to the embodiment. FIG. 2 is a functional block diagram of a call terminal, a relay device, a call management system, and a conversion system that constitute a part of the call system of the embodiment. It is a conceptual diagram showing a visual information management table. It is a key map showing a change quality management table. It is a conceptual diagram which shows a relay apparatus management table. It is a conceptual diagram which shows a terminal information management table. It is a conceptual diagram which shows a terminal state management table. It is a conceptual diagram showing a destination list management table. It is a conceptual diagram which shows a session management table. It is a conceptual diagram showing a conversion management table. It is a conceptual diagram which shows a quality management table. FIG. 9 is a sequence diagram showing a process of a preparation stage for starting a call between terminals. It is a flowchart which shows extraction of an operating state. It is a conceptual diagram showing a destination list. It is a flowchart which determines whether transmission of an operation state is possible. FIG. 9 is a sequence diagram illustrating a call start request. It is a flowchart which shows determination of a communication system. FIG. 11 is a sequence diagram illustrating a process of establishing a communication session before making a call between two dedicated terminals. FIG. 9 is a sequence diagram illustrating a process of transmitting and receiving call data between two dedicated terminals. FIG. 9 is a sequence diagram illustrating a process of establishing a communication session before making a call between a dedicated terminal and a non-dedicated terminal. FIG. 9 is a sequence diagram illustrating a process of transmitting and receiving call data between a dedicated terminal and a non-dedicated terminal. FIG. 4 is a conceptual diagram illustrating the image quality of image data converted by a conversion system.

  Hereinafter, an embodiment of the present invention will be described with reference to FIGS.

<<< Overall Configuration of Embodiment >>>
FIG. 1 is a schematic diagram of a call system according to an embodiment of the present invention. As shown in FIG. 1, the communication system 1 includes a plurality of communication terminals (10aa, 10ab,...), A display (120aa, 120ab,...) For each of the communication terminals (10aa, 10ab,. It is configured by a relay device (30a, 30b, 30c), a call management system 50, a conversion system 80, a program providing system 90, and a maintenance system 100. The communication system 1 performs communication of image data and sound data as an example of call data, thereby realizing a video conference between remote locations and the like. The plurality of routers (70a, 70b, 70c, 70d, 70ab, 70cd) select an optimal route for call data.

  The call terminals (10aa, 10ab, 10ac,...), The relay device 30a, and the router 70a are communicably connected by the LAN 2a. The call terminals (10ba, 10bb, 10bc, ...), the relay device 30b, and the router 70b are communicably connected by the LAN 2b. The LANs 2a and 2b are communicably connected by a dedicated line 2ab including a router 70ab. Further, the LAN 2a, the LAN 2b, and the dedicated line 2ab are constructed in a predetermined area X. For example, the region X is Japan, the LAN 2a is built in a business office in Tokyo, and the LAN 2b is built in a business office in Osaka.

  On the other hand, the call terminals (10ca, 10cb, 10cc,...), The relay device 30c, and the router 70c are communicably connected by the LAN 2c. The call terminals (10da, 10db, 10dc, ...), the conversion system 80, and the router 70d are communicably connected by the LAN 2d. The LAN 2c and the LAN 2d are communicably connected by a dedicated line 2cd including a router 70cd. Further, the LAN 2c, the LAN 2d, and the dedicated line 2cd are constructed in a predetermined area Y. For example, region Y is the United States of America, LAN2c is built in a New York office, and LAN2d is Washington, DC. C. It is built in the office. The region X and the region Y are communicably connected from the routers (70ab, 70cd) via the Internet 2i.

  In the following, “call terminal” is simply represented as “terminal”, and “call management system” is simply represented as “management system”. An arbitrary terminal among the plurality of terminals (10aa, 10ab,...) Is represented as “terminal 10”, and an arbitrary display among the plurality of displays (120aa, 120ab,...) Is represented as “display 120”. An arbitrary relay device among the plurality of relay devices (30a, 30b, 30c) is represented as “relay device 30”. Further, a terminal as a request source requesting the start of a video conference is represented as a “request source terminal”, and a terminal as a destination (relay destination) as a request destination is represented as a “destination terminal”. An arbitrary router among the routers (70a, 70b, 70c, 70d, 70ab, 70cd) is represented as "router 70".

  The management system 50, the program providing system 90, and the maintenance system 100 are connected to the Internet 2i. In this embodiment, the conversion system 80 is connected to the router 70d in the LAN 2d in the area Y. The management system 50, the program providing system 90, and the maintenance system 100 may be installed in the area X or the area Y, or may be installed in an area other than these.

  Further, in the present embodiment, the communication network 2 of the present embodiment is constructed by the LAN 2a, the LAN 2b, the dedicated line 2ab, the Internet 2i, the dedicated line 2cd, the LAN 2c, and the LAN 2d. The communication network 2 may include not only a wire but also a place where wireless communication such as WiFi (Wireless Fidelity) or Bluetooth (registered trademark) is performed.

  Also, in FIG. 1, four sets of numbers shown below each terminal 10, each relay device 30, the management system 50, each router 70, the conversion system 80, the program providing system 90, and the maintenance system 100 are general. IP addresses in typical IPv4 are simply shown. For example, the IP address of the terminal 10aa is “1.2.1.3”. Further, instead of IPv4, IPv6 may be used, but for simplification of the description, the description is made using IPv4.

  Note that each terminal 10 can be used not only for calls between a plurality of offices, calls between different rooms in the same office, but also calls in the same room, and calls between outdoor and indoor or between outdoor and outdoor. May be used. When each terminal 10 is used outdoors, wireless communication such as a mobile phone communication network is performed.

  Each terminal 10 illustrated in FIG. 1 is a terminal that implements a user's call by transmitting and receiving call data, and is, for example, a terminal for a video conference. Further, the terminal 10 transmits and receives call data using a predetermined communication method (a call control method for connecting or disconnecting with a call destination and an encoding method for converting the call data into IP packets). Do.

  The call control methods include (1) SIP (Session Initiation Protocol), (2) H.323, (3) a protocol extended from SIP, (4) instant messenger protocol, (5) MESSAGE method of SIP. (6) Internet Relay Chat (IRC), (7) a protocol that is an extension of the instant messenger protocol, and the like. Among them, (4) Instant Messenger protocol is, for example, (4-1) XMPP (Extensible Messaging and Presence Protocol), or (4-2) ICQ (registered trademark), AIM (registered trademark), or Skype (registered trademark). Trademark). Also, (7) a protocol that is an extension of the instant messenger protocol is, for example, Jingle.

  Further, among the plurality of terminals 10, for example, a communication method in which a call control method is an instant messenger protocol (or a protocol extended from the instant messenger protocol) and an encoding method is SVC (Scalable Video Coding) is used. The terminal 10 that performs communication is represented as “dedicated terminal A”. Further, among the plurality of terminals 10, the terminal 10 in which at least one of the call control method and the encoding method uses a communication method different from the dedicated terminal A is represented as "non-dedicated terminal D". Further, in the present embodiment, as an example of two terminals having different communication systems, “dedicated terminal A” is described as a terminal manufactured, sold, or managed by a specific company, and “non-dedicated terminal D” Description will be given as a terminal manufactured, sold, or managed by a company other than the specific company. In the present embodiment, terminals manufactured, sold, or managed by different companies as described above often use different communication methods, and therefore, description will be made using the above example. In addition, as an example of two terminals having different communication methods, among terminals manufactured or sold by the same company, a terminal having a new manufacturing time or sales time is referred to as “dedicated terminal A”, and a terminal having an old manufacturing time or sales time is referred to as “dedicated terminal A”. "Non-dedicated terminal D" may be used.

  Each relay device 30 is a computer system that relays call data between a plurality of terminals 10. The management system 50 is a computer system that centrally manages login authentication from the terminal 10, management of a call status of the terminal 10, management of a destination list, and communication status of the relay device 30. Note that the image of the image data may be a moving image or a still image, or may be both a moving image and a still image.

  Further, the conversion system 80 plays a role of a Signaling Gateway for converting a call control signal and a Video / Audio Gateway for coding call data. That is, the conversion system 80 is a gateway for mutually converting the communication method of the call data transmitted from the request source terminal and the communication method (call control method, coding method) of the call data transmitted from the destination terminal, At least one of the call control method and the coding method is converted.

  The program providing system 90 is a computer system that provides a program used for each of the terminal 10, the relay device 30, the management system 50, the conversion system 80, and the maintenance system 100 to each other via the communication network 2.

  The maintenance system 100 is a computer system for maintaining, managing, or maintaining at least one of the terminal 10, the relay device 30, the management system 50, the conversion system 80, and the program providing system 90. For example, when the maintenance system 100 is installed in the country and the terminal 10, the relay device 30, the management system 50, the conversion system 80, or the program providing system 90 is installed outside the country, the maintenance system 100 is connected via the communication network 2. And remotely performs maintenance such as maintenance, management, and maintenance of at least one of the terminal 10, the relay device 30, the management system 50, the conversion system 80, and the program providing system 90. In addition, the maintenance system 100 does not pass through the communication network 2 and includes a model number, a serial number, a sales destination in at least one of the terminal 10, the relay device 30, the management system 50, the conversion system 80, and the program providing system 90. Perform maintenance such as maintenance and inspection, or management of failure history.

  Next, a first communication pattern for realizing a call between two dedicated terminals A will be described with reference to FIGS. 2 and 3. FIG. 2 is a conceptual diagram showing a communication situation when a call is made between call terminals of the same communication method.

  As shown in FIG. 2, in the first communication pattern, the communication system 1 performs communication of the communication data using the H.264 / SVC video coding standard. Specifically, as shown in FIG. 2, in the communication system 1, between the request source terminal as the dedicated terminal A and the destination terminal as the dedicated terminal A, various types of information are transmitted via the management system 50. A management communication session sei for transmitting and receiving management information is established. In addition, between the request source terminal and the destination terminal, four types of data of high-resolution image data, medium-resolution image data, low-resolution image data, and sound data are transmitted and received via the relay device 30. Are established.

  In FIG. 2, four communication sessions established between the request source terminal and the relay device 30 are shown as first communication sessions sed1 for call data. The four communication sessions established between the relay device 30 and the destination terminal are shown as a second communication session sed2 for call data.

  Here, the resolution of the image of the image data handled in the first communication pattern shown in FIG. 2 will be described with reference to FIG. FIG. 3 is a conceptual diagram showing the image quality of image data transmitted and received according to the SVC standard in FIG.

  As shown in FIG. 3A, a low-resolution image serving as a base image is composed of 160 pixels horizontally and 120 pixels vertically, and as shown in FIG. There is a medium resolution image composed of 320 pixels and 240 pixels vertically, and a high resolution image composed of 640 pixels horizontally and 480 pixels vertically as shown in FIG. 3C. Among them, when passing through the narrow band path, the low-quality image data composed of only the low-resolution image data serving as the base image is relayed by the relay device 30. When the band is relatively wide, the relay device 30 relays low-resolution image data serving as a base image and medium-quality image data including medium-resolution image data. When the bandwidth is very wide, the relay device 30 relays high-quality image data including low-resolution image data, medium-resolution image data, and high-resolution image data, which are base images.

  Next, a second communication pattern for realizing a call between the dedicated terminal A and the non-dedicated terminal D will be described with reference to FIGS. FIG. 4 is a conceptual diagram showing a communication situation when a call is realized between call terminals of different communication methods.

  As shown in FIG. 4, in the second communication pattern, the communication system 1 uses the H.264 / SVC video coding standard and the H.264 / AVC (Advanced Video Coding) video coding standard. Communication of call data is performed using standards. Specifically, as shown in FIG. 4, in the call system 1, between the request source terminal as the dedicated terminal A and the destination terminal as the non-dedicated terminal D via the management system 50, A management communication session sei for transmitting and receiving various management information has been established.

  In addition, between the request source terminal (an example of the first call terminal) and the conversion system 80, high-resolution image data, medium-resolution image data, low-resolution image data are transmitted by the H.264 / SVC via the relay device 30. Four communication sessions for transmitting and receiving each of the four pieces of image data of the resolution and the sound data are established. In FIG. 4, four communication sessions established between the request source terminal and the relay device 30 are shown as a first communication session sed11 for call data. The four communication sessions established between the relay device 30 and the conversion system 80 are shown as a second communication session sed12 for call data.

  Furthermore, between the conversion system 80 and the destination terminal (an example of the second call terminal), two communications for transmitting and receiving two data of medium-resolution image data and sound data by H.264 / AVC. A session has been established. In FIG. 4, two communication sessions established between the conversion system 80 and the destination terminal are shown as a third communication session sed13 for call data.

  Here, the resolution of the image of the image data handled in the second communication pattern shown in FIG. 4 will be described with reference to FIGS. FIG. 5 is a conceptual diagram showing the image quality of image data transmitted and received according to the AVC standard in FIG.

  In the first communication session sed11 and the second communication session sed12 shown in FIG. 4, as in the first communication session sed1 and the second communication session sed2 shown in FIG. Image data of three resolutions shown in a), (b) and (c) are transmitted and received. On the other hand, in the third communication session sed13 shown in FIG. 4, the medium resolution image data shown in FIG. 5 is transmitted and received.

<< Hardware Configuration of Embodiment >>
Next, a hardware configuration of the present embodiment will be described. FIG. 6 is an external view of the call terminal according to the present embodiment. As shown in FIG. 6, the terminal 10 includes a housing 1100, an arm 1200, and a camera housing 1300. Of these, an intake surface (not shown) formed by a plurality of intake holes is provided on a front wall surface 1110 of the housing 1100, and a plurality of exhaust holes is formed on a rear wall surface 1120 of the housing 1100. Exhaust surface 1121 is provided. Thus, by driving the cooling fan built in the housing 1100, outside air behind the terminal 10 can be taken in through the intake surface (not shown) and exhausted to the rear of the terminal 10 through the exhaust surface 1121. A sound collecting hole 1131 is formed in the right wall surface 1130 of the housing 1100, and sounds such as voice, sound, and noise can be collected by a built-in microphone 114 described later.

  An operation panel 1150 is formed on the right wall 1130 side of the housing 1100. The operation panel 1150 is provided with a plurality of operation buttons (108a to 108e) described later, a power switch 109 described later, and an alarm lamp 119 described later, and outputs an output sound from a built-in speaker 115 described later. A sound output surface 1151 formed by a plurality of sound output holes for passing through is formed. On the left side wall 1140 side of the housing 1100, a housing portion 1160 is formed as a recess for housing the arm 1200 and the camera housing 1300. A plurality of connection ports (1132a to 1132c) for electrically connecting cables to a display I / F 117 described later are provided on a right wall surface 1130 of the housing 1100. On the other hand, a connection port (not shown) for electrically connecting a cable 120c for the display 120 to an external device connection I / F 118 described later is provided on a left wall surface 1140 of the housing 1100.

  In the following, “operation button 108” is used to indicate any one of the operation buttons (108a to 108e), and “operation button 108” is used to indicate any one of the connection ports (1132a to 1132c). This will be described using the “connection port 1132”.

  Next, the arm 1200 is attached to the housing 1100 via a torque hinge 1210, and the arm 1200 is configured to be vertically rotatable with respect to the housing 1100 within a range of a tilt angle θ1 of 135 degrees. ing. FIG. 6 shows a state where the tilt angle θ1 is 90 degrees. The camera housing 1300 is provided with a built-in camera 112 described later, and can capture an image of a user, a document, a room, and the like. Further, a torque hinge 1310 is formed in the camera housing 1300. The camera housing 1300 is attached to the arm 1200 via a torque hinge 1310. The camera housing 1300 is attached to the arm 1200 via a torque hinge 1310. The camera housing 1300 is positioned at a pan angle θ2 of ± 180 degrees with respect to the arm 1200 with the state shown in FIG. And within a range of ± 45 degrees of tilt angle θ3.

  Note that the relay device 30, the management system 50, the conversion system 80, the program providing system 90, and the maintenance system 100 are the same as the appearances of general server computers, respectively, and the description of the appearances is omitted.

  FIG. 7 is a hardware configuration diagram of the terminal according to the present embodiment. As shown in FIG. 7, the terminal 10 according to the present embodiment includes a CPU (Central Processing Unit) 101 that controls the entire operation of the terminal 10 and a program used to drive the CPU 101 such as an IPL (Initial Program Loader). ROM (Read Only Memory) 102 stored therein, RAM (Random Access Memory) 103 used as a work area of the CPU 101, a flash memory 104 storing various data such as a program for the terminal 10, image data, sound data, and the like, the CPU 101 (Solid State Drive) 105 that controls reading or writing of various data to the flash memory 104 according to the control of the above, a media drive 107 that controls reading or writing (storage) of data to or from a recording medium 106 such as a flash memory, and the terminal 10. Operation when selecting a destination for An operation button 108, a power switch 109 for switching ON / OFF the power of the terminal 10, and a network I / F (Interface) 111 for data transmission using the communication network 2 are provided.

  Further, the terminal 10 includes a built-in camera 112 that obtains image data by capturing an image of a subject under the control of the CPU 101, an image sensor I / F 113 that controls driving of the camera 112, a built-in microphone 114 that inputs sound, , A sound input / output I / F 116 for processing input / output of a sound signal between the microphone 114 and the speaker 115 under the control of the CPU 101, and image data to an external display 120 under the control of the CPU 101. A display I / F 117 for transmission, an external device connection I / F 118 for connecting various external devices, an alarm lamp 119 for notifying an abnormality of various functions of the terminal 10, and the above-described components are shown in FIG. And a bus line 110 such as an address bus or a data bus for electrically connecting to a bus.

  The display 120 is a display unit including a liquid crystal or an organic EL for displaying an image of a subject, operation icons, and the like. The display 120 is connected to the display I / F 117 by a cable 120c. The cable 120c may be a cable for analog RGB (VGA) signal, a cable for component video, or a signal for HDMI (High-Definition Multimedia Interface) or DVI (Digital Video Interface) signal. Cable.

  The camera 112 includes a lens and a solid-state imaging device that converts light into electric charge to convert an image (video) of a subject into an electron. As the solid-state imaging device, a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) is used. Are used.

  An external camera, an external microphone, an external speaker, and the like are connected to the external device connection I / F 118 by a USB (Universal Serial Bus) cable or the like inserted into the connection port 1132 of the housing 1100 shown in FIG. Of external devices can be electrically connected. When an external camera is connected, the external camera is driven in preference to the built-in camera 112 under the control of the CPU 101. Similarly, when an external microphone is connected or an external speaker is connected, the external microphone or the internal speaker 115 is given priority over the built-in microphone 114 or the built-in speaker 115 under the control of the CPU 101. The external speaker is driven.

  Note that the recording medium 106 is configured to be detachable from the terminal 10. In addition, as long as it is a non-volatile memory that reads or writes data under the control of the CPU 101, an EEPROM (Electrically Erasable and Programmable ROM) or the like may be used instead of the flash memory 104.

  FIG. 8 is a hardware configuration diagram of the management system according to the present embodiment of the present invention. The management system 50 includes a CPU 201 for controlling the operation of the entire management system 50, a ROM 202 storing a program used for driving the CPU 201 such as an IPL, a RAM 203 used as a work area of the CPU 201, and various programs such as a program for the management system 50. HD 204 for storing data, HDD (Hard Disk Drive) 205 for controlling reading or writing of various data to HD 204 under control of CPU 201, and medium for controlling reading or writing (storage) of data to recording medium 206 such as a flash memory. A drive 207, a display 208 for displaying various information such as a cursor, a menu, a window, characters, or an image; a network I / F 209 for performing data communication using the communication network 2; A keyboard 211 having a plurality of keys for inputting numerical values, various instructions, etc., a mouse 212 for selecting and executing various instructions, selecting a processing target, moving a cursor, etc., a CD as an example of a removable recording medium A CD-ROM drive 214 for controlling reading or writing of various data to and from a ROM (Compact Disc Read Only Memory) 213, and an address for electrically connecting the above-described components as shown in FIG. A bus line 210 such as a bus or a data bus is provided.

  On the other hand, the relay device 30, the conversion system 80, the program providing system 90, and the maintenance system 100 have the same hardware configuration as the management system 50, and a description thereof will be omitted. However, various data such as programs for controlling the relay device 30, the conversion system 80, the program providing system 90, and the maintenance system 100 are stored in each HD 204.

  Each program for the terminal 10, the relay device 30, the conversion system 80, the program providing system 90, and the maintenance system 100 is a computer-readable recording medium (recording) in a file in an installable or executable format. The media may be recorded and distributed. Other examples of the recording medium include CD-R (Compact Disc Recordable), DVD (Digital Versatile Disk), and Blu-ray Disc.

<< Functional Configuration of Embodiment >>
Next, a functional configuration of the present embodiment will be described. FIG. 9 is a functional block diagram of the terminal 10, the relay device 30, the management system 50, and the conversion system 80 that constitute a part of the communication system 1 of the present embodiment. In FIG. 9, the terminal 10, the relay device 30, the management system 50, and the conversion system 80 are connected so that data communication can be performed via the communication network 2.

<Functional configuration of terminal>
The terminal 10 includes a transmission / reception unit 11, an operation input reception unit 12, a login request unit 13, an imaging unit 14, a sound input unit 15a, a sound output unit 15b, a display control unit 16, a delay detection unit 17, a destination list creation unit 18, It has a storage / read processing unit 19. These units are functions implemented by operating any of the components shown in FIG. 7 by a command from the CPU 101 in accordance with a program for the terminal 10 expanded on the RAM 103 from the flash memory 104. Or means. In addition, the terminal 10 includes a storage unit 1000 configured by the RAM 103 illustrated in FIG. 7 and the flash memory 104 illustrated in FIG.

(Visual information management table)
FIG. 10 is a conceptual diagram illustrating the visual information management table. In the storage unit 1000, a visual information management DB (Data Base) 1001 configured by a visual information management table as shown in FIG. 10 is constructed. In the visual information management table, visual information represented by a destination list displayed on the display 120 is managed in association with each operating state information indicating the operating state of the destination terminal. Each visual information is, for example, each icon in a form as shown in FIG. Each piece of visual information constituting the visual information management table may be sent from the management system 50 when the request source terminal makes a login request in step S22 described below, or may be stored in the storage unit 1000 before the request source terminal is shipped from the factory. May be stored.

  Note that the visual information according to the present embodiment includes first visual information that visually indicates that the communication method used by the destination terminal is the communication method used by the request source terminal (dedicated terminal A); It visually indicates that the communication method used in (1) is not the communication method used in the request source terminal (dedicated terminal A), and is classified into second visual information that is visually different from the first visual information. Among them, the first visual information includes visual information indicating that the operation state is online (calling is possible), online (during a call), online (temporarily interrupted), or offline. In addition, the second visual information indicates that the management system 50 cannot acquire the operation state because the destination terminal is the non-dedicated terminal D, and the operation state is unknown (or the communication method of the destination terminal is the dedicated terminal A. The communication method is not used).

(Each terminal function configuration)
Next, each functional configuration of the terminal 10 will be described in detail with reference to FIGS. 7 and 9. In the following, in describing each functional configuration of the terminal 10, among the components illustrated in FIG. 7, the relationship with the main components for realizing each functional configuration of the terminal 10 will also be described. .

  The transmission / reception unit 11 of the terminal 10 illustrated in FIG. 9 is realized by a command from the CPU 101 illustrated in FIG. 7 and the network I / F 111 illustrated in FIG. To transmit and receive various data (or information) to / from the terminal, device or system. The transmission / reception unit 11 starts receiving status information indicating the status of each terminal as a destination candidate from the management system 50 before starting communication with a desired destination terminal. Note that this status information includes not only the operating status of each terminal 10 (online or offline status) but also whether the terminal 10 is online, whether it is possible to make a call, is on a call, is away from the desk, and the like. Shows the detailed state of. The state information includes not only the operating state of each terminal 10 but also the cable 120c of the terminal 10 which is disconnected from the terminal 10, outputs a sound but does not output an image, or does not output a sound. (MUTE) indicates various states. Hereinafter, as an example, a case where the state information indicates the operating state will be described.

  The operation input receiving unit 12 is realized by a command from the CPU 101 shown in FIG. 7 and the operation button 108 and the power switch 109 shown in FIG. 7, and receives various inputs by the user. For example, when the user turns on the power switch 109 shown in FIG. 7, the operation input receiving unit 12 shown in FIG. 9 receives the power on and turns on the power.

  The login request unit 13 is realized by a command from the CPU 101 shown in FIG. 7, and requests the login from the transmission / reception unit 11 to the management system 50 via the communication network 2 in response to the reception of the power-on. , And the current IP address of the requesting terminal. When the user turns the power switch 109 from the ON state to the OFF state, the operation input receiving unit 12 completely turns off the power after the transmitting / receiving unit 11 transmits state information indicating that the power is turned off to the management system 50. I do. Thus, the management system 50 can recognize that the terminal 10 has been turned off from the power on.

  The imaging unit 14 is realized by a command from the CPU 101 illustrated in FIG. 7 and the camera 112 and the imaging element I / F 113 illustrated in FIG. 7, captures an image of a subject, and obtains an image obtained by capturing the captured image. Output data.

  The sound input unit 15a is realized by a command from the CPU 101 shown in FIG. 7 and the sound input / output I / F 116 shown in FIG. 7, and the microphone 114 converts the user's sound into a sound signal. Thereafter, sound data relating to the sound signal is input. The sound output unit 15b is realized by a command from the CPU 101 shown in FIG. 7 and the sound input / output I / F 116 shown in FIG. 7, outputs a sound signal related to sound data to the speaker 115, The sound is output from 115.

  The display control unit 16 is realized by a command from the CPU 101 shown in FIG. 7 and the display I / F 117 shown in FIG. 7, and combines received image data having different resolutions as described below. Control for transmitting the combined image data to the display 120 is performed. In addition, the display control unit 16 can transmit the information of the destination list received from the management system 50 to the display 120 and cause the display 120 to display the destination list.

  The display control unit 16 extracts the corresponding visual information by searching the visual information management table (see FIG. 10) using the operating state information received from the management system 50 by the transmission / reception unit 11 as a search key. It is displayed on the display 120 of the terminal 10 while being included in the destination list.

  The delay detection unit 17 is implemented by a command from the CPU 101 illustrated in FIG. 7 and detects a delay time (ms) of image data or sound data transmitted from another terminal 10 via the relay device 30. .

  The destination list creation unit 18 is realized by an instruction from the CPU 101 shown in FIG. 7 and, based on the destination list information stored in the storage unit 1000 and the terminal status information, the terminal 10 as a destination candidate. Create a destination list that reflects the status.

  In addition, the destination list creating unit 18 extracts the corresponding visual information by searching the visual information management table (see FIG. 10) based on the terminal operating state information included in the terminal state information. Further, the destination list creating unit 18 assigns the extracted visual information to the destination list frame in the destination list information for each terminal ID and destination name in the destination list information.

  The storage / read processing unit 19 is executed by a command from the CPU 101 shown in FIG. 7 and the SSD 105 shown in FIG. 7 or realized by a command from the CPU 101, and stores various data in the storage unit 1000, A process of reading various data stored in the unit 1000 is performed. The storage unit 1000 stores a terminal ID (Identification) for identifying the terminal 10, a password, and the like. Further, the storage unit 1000 overwrites and stores the image data and the sound data received when making a call with the destination terminal every time the data is received. Among them, an image is displayed on the display 120 by the image data before overwriting, and a sound is output from the speaker 115 by the sound data before overwriting.

  Note that the terminal ID of the present embodiment and a relay device ID to be described later indicate identification information such as a language, a character, a symbol, or various signs used for uniquely identifying the terminal 10 and the relay device 30, respectively. Further, the terminal ID and the relay device ID may be identification information in which at least two of the above-mentioned languages, characters, symbols, and various signs are combined.

<Functional configuration of relay device>
The relay device 30 includes a transmission / reception unit 31, a state detection unit 32, a data quality check unit 33, a change quality management unit 34, a data quality change unit 35, and a storage / read processing unit 39. Each of these units has a function or a function realized by operating any one of the components shown in FIG. 8 by a command from the CPU 201 according to a program for the relay device 30 expanded on the RAM 203 from the HD 204 or Means. Further, the relay device 30 includes a storage unit 3000 configured by the RAM 203 illustrated in FIG. 8 and / or the HD 204 illustrated in FIG.

(Change quality control table)
FIG. 11 is a conceptual diagram showing a change quality management table. In the storage unit 3000, a changed quality management DB 3001 constituted by a changed quality management table as shown in FIG. 11 is constructed. In the change quality management table, the IP address of the terminal 10 as a relay destination (destination) of the image data and the image quality of the image data relayed by the relay device 30 are managed in association with the relay destination.

(Each functional configuration of the relay device)
Next, each functional configuration of the relay device 30 will be described in detail. In the following, in describing each functional configuration of the relay device 30, among the components illustrated in FIG. 8, the relationship with main components for realizing each functional configuration of the relay device 30 is also described. explain.

  The transmission / reception unit 31 of the relay device 30 illustrated in FIG. 9 is realized by a command from the CPU 201 illustrated in FIG. 8 and the network I / F 209 illustrated in FIG. It sends and receives various data (or information) to and from other terminals, devices, or systems. Further, the transmitting / receiving unit 31 initializes a communication session in the own device.

  Further, the transmission / reception unit 31 instructs the destination indicated by the IP address of the request source terminal of the IP address received by the transmission / reception unit 31 to start a communication session (first communication session). To start session information for starting. In addition, the transmission / reception unit 31 instructs the destination indicated by the IP address of the conversion system 80 to start a communication session (second communication session) among the IP addresses received by the transmission / reception unit 31. To start session information and the IP address of the destination terminal.

  The state detection unit 32 is implemented by a command from the CPU 201 illustrated in FIG. 8 and detects the operation state of the relay device 30 including the state detection unit 32. The operating states include “online”, “offline”, “on a call”, and “temporarily suspended”.

  The data quality checking unit 33 is realized by a command from the CPU 201 shown in FIG. 8, searches the change quality management table (see FIG. 11) using the IP address of the destination terminal as a search key, and relays the data. The image quality of the relayed image data is confirmed by extracting the image quality of the image data.

  The change quality management unit 34 is realized by an instruction from the CPU 201 shown in FIG. 8 and, based on quality information described later and transmitted from the management system 50, the contents of the change quality management table (see FIG. 11). To change. For example, a video conference is performed by transmitting and receiving high-quality image data between a request source terminal (terminal 10aa) having a terminal ID of “01aa” and a destination terminal (terminal 10ba) having a terminal ID of “01ba”. During the conference, the request source terminal (terminal 10bb) and the destination terminal (terminal 10ca) for performing another video conference start a video conference via the communication network 2 or the like, so that the destination terminal (terminal 10ba) When a delay in receiving image data occurs, the relay device 30 lowers the image quality of the image data that has been relayed so far from high image quality to medium image quality. In such a case, the contents of the change quality management table (see FIG. 11) are changed based on the quality information indicating the medium image quality so as to reduce the image quality of the image data relayed by the relay device 30 from high image quality to medium image quality. Is done.

  The data quality changing unit 35 is realized by an instruction from the CPU 201 shown in FIG. 8, and converts the image quality of the image data sent from the transmission source terminal into the changed quality management table (see FIG. 11). Change based on the content of

  The storage / read processing unit 39 is realized by a command from the CPU 201 shown in FIG. 8 and the HDD 205 shown in FIG. 8, and stores various data in the storage unit 3000 or is stored in the storage unit 3000. A process of reading various data is performed.

<Functional configuration of management system>
The management system 50 includes a transmission / reception unit 51, a terminal authentication unit 52, a state management unit 53, an extraction unit 54, a determination unit 55, a session management unit 56, a quality determination unit 57, a delay time management unit 58, and a storage / read processing unit 59. have. Each of these units has a function or a function realized by operating any one of the components shown in FIG. 8 according to a command from the CPU 201 in accordance with a program for the management system 50 expanded on the RAM 203 from the HD 204 or Means. Further, the management system 50 has a storage unit 5000 constructed by the HD 204 shown in FIG. This storage unit 5000 stores destination list frame data described later.

(Relay device management table)
FIG. 12 is a conceptual diagram illustrating the relay device management table. In the storage unit 5000, a relay device management DB 5001 configured by a relay device management table as shown in FIG. 12 is constructed. In this relay device management table, for each relay device ID of each relay device 30, the operating status of each relay device 30, the reception date and time when status information indicating the operating status is received by the management system 50, and the IP address of the relay device 30 , And the maximum data call speed (Mbps) in the relay device 30 are managed in association with each other. For example, in the relay device management table shown in FIG. 12, the relay device 30a whose relay device ID is “111a” has the operation status “online” and the date and time when the status information is received by the management system 50 is “2011”. At 13:00 on November 10, 2008, it is shown that the IP address of the relay device 30a is "1.2.1.2" and the maximum data communication speed in the relay device 30a is 100 Mbps. I have.

(Terminal information management table)
FIG. 13 is a conceptual diagram showing a terminal information management table. In the storage unit 5000, a terminal information management DB 5002 constituted by a terminal information management table as shown in FIG. 13 is constructed. In this terminal information management table, the authentication password, the model number of the terminal 10, the serial number of the terminal 10, and the communication method of the terminal 10 are associated with each terminal ID of all the terminals 10 managed by the management system 50. Managed. For example, in the terminal information management table shown in FIG. 13, the terminal ID of the terminal 10aa is “01aa”, the password is “aaaa”, the model number is “9001”, the serial number is “2001”, and the communication method is It is shown as "dedicated".

  The communication method “dedicated” indicates a communication method used by the dedicated terminal A shown in FIGS. The communication method “non-dedicated 1” indicates the communication method used by the non-dedicated terminal D shown in FIG. Further, the communication method “non-dedicated 2” indicates a communication method other than the communication methods used by the dedicated terminal A and the non-dedicated terminal D, respectively.

(Terminal status management table)
FIG. 14 is a conceptual diagram showing a terminal status management table. In the storage unit 5000, a terminal state management DB 5003 constituted by a terminal state management table as shown in FIG. 14 is constructed. In this terminal status management table, for each terminal ID of each terminal 10, a terminal name when each terminal 10 is a destination, an operation state of each terminal 10, and a reception date and time when login request information described below is received by the management system 50. , And the IP address of the terminal 10 are managed in association with each other. For example, in the terminal status management table shown in FIG. 14, the terminal 10aa having the terminal ID “01aa” has the terminal name “Japan Tokyo Office AA terminal” and the operation state “online (communicable)”. Indicates that the date and time when the login request information was received by the management system 50 is “13:40 on November 10, 2011”, and that the IP address of this terminal 10aa is “1.2.1.3”. Have been.

  However, in the terminal state management table, the IP addresses of the terminals 10 other than the dedicated terminal A, that is, the non-dedicated terminals D and the like are not managed because they are not managed.

(Destination list management table)
FIG. 15 is a conceptual diagram showing a destination list management table. In the storage unit 5000, a destination list management DB 5004 configured by a destination list management table as shown in FIG. In this destination list management table, all terminal IDs of destination terminals registered as destination terminal candidates are managed in association with the terminal ID of the request source terminal that requests the start of a call. For example, in the destination list management table illustrated in FIG. 15, a candidate of a destination terminal that can request a start of a call from a request source terminal (terminal 10aa) whose terminal ID is “01aa” is “terminal ID“ A terminal 10ab having a terminal ID of “01ab”, a terminal 10ba having a terminal ID of “01bb”, a terminal 10bb having a terminal ID of “01bb”, and the like are shown. The candidates for the destination terminal are updated by being added or deleted in response to a request for addition or deletion to the management system 50 from any requesting terminal. In the terminal status management table (see FIG. 14), the IP addresses of the terminals 10 other than the dedicated terminal A are not managed, but in the destination list management table (see FIG. 15), the terminals 10 other than the dedicated terminal A are not managed. Terminal IDs are managed.

(Session management table)
FIG. 16 is a conceptual diagram showing a session management table. In the storage unit 5000, a session management DB 5005 configured by a session management table as shown in FIG. 16 is constructed. In this session management table, the relay device ID of the relay device 30 used for relaying image data and sound data, the terminal ID of the request source terminal, the terminal ID of the destination terminal, and the reception of image data at the destination terminal The delay time (ms) and the delay time information indicating the delay time are managed in association with the reception date and time received from the destination terminal and received by the management system 50. For example, in the session management table shown in FIG. 16, the relay device 30a (relay device ID “111a”) includes a request source terminal (terminal 10aa) having a terminal ID “01aa” and a relay terminal 30a (terminal 10aa) having a terminal ID “01ca”. The image data and the sound data are relayed to and from the destination terminal (terminal 10ca), and the delay time of the image data at “14:00 on November 10, 2011” at the destination terminal (terminal 10ca). It is shown to be 200 (ms). When a call is made between the two terminals 10, the reception date and time of the delay time information may be managed based on the delay time information transmitted from the request source terminal instead of the destination terminal. However, when a call is made between three or more terminals 10, the reception date and time of the delay time information is managed based on the delay time information transmitted from the terminal 10 on the image data and sound data receiving side. .

(Conversion management table)
FIG. 17 is a conceptual diagram showing a conversion management table. In the storage unit 5000, a conversion management DB 5006 configured by a conversion management table as shown in FIG. 17 is constructed. In this conversion management table, the terminal ID of the non-dedicated terminal (including the non-dedicated 1 and non-dedicated 2 terminals), the IP address of the conversion system 80, and the IP address of the non-dedicated terminal are managed in association with each other.

(Quality control table)
FIG. 18 is a conceptual diagram showing a quality management table. In the storage unit 5000, a quality management DB 5007 constituted by a quality management table as shown in FIG. In this quality management table, the delay time information indicating the delay time of the image data so that the longer the delay time (ms) of the image data at the request source terminal or the destination terminal is, the lower the image quality of the image data to be relayed by the relay device 30 is. And image quality information indicating the image quality (image quality) of the image data are managed in association with each other.

(Each functional configuration of the management system)
Next, each functional configuration of the management system 50 will be described in detail. In the following, in describing each functional configuration of the management system 50, among the components illustrated in FIG. 8, a relationship with main components for realizing each functional configuration of the management system 50 is also described. explain.

  The transmission / reception unit 51 is executed by a command from the CPU 201 shown in FIG. 8 and the network I / F 209 shown in FIG. 8, and communicates with other terminals, devices or systems via the communication network 2 and various data ( Or information).

  The terminal authentication unit 52 is realized by a command from the CPU 201 shown in FIG. 8, and uses the terminal ID and the password included in the login request information received via the transmission / reception unit 51 as a search key, and performs terminal information management. The terminal authentication is performed by searching a table (see FIG. 13) and determining whether the same terminal ID and password are managed in the terminal information management table.

  The state management unit 53 is realized by a command from the CPU 201 shown in FIG. 8, and stores the request source in the terminal state management table (see FIG. 14) in order to manage the operation state of the request source terminal that has made the login request. The terminal ID of the terminal, the operation state of the request source terminal, the reception date and time when the login request information was received by the management system 50, and the IP address of the request source terminal are stored and managed in association with each other. Further, the state management unit 53 changes the state of the power switch 109 of the terminal 10 from ON to OFF by the user, and the terminal state based on the state information sent from the terminal 10 indicating that the power is to be turned off. The online operation state of the management table (see FIG. 14) is changed to offline.

  The extraction unit 54 is realized by an instruction from the CPU 201 shown in FIG. 8, searches each management DB constructed in the storage unit 5000 using various search keys, and stores data (information) corresponding to the search keys. Extract as search results.

  For example, the extraction unit 54 searches the destination list management table (see FIG. 15) using the terminal ID of the request source terminal that has made the login request as a key, and determines the terminal ID of a destination terminal candidate that can make a call with the request source terminal. Extract. Further, the extraction unit 54 searches the terminal status table (see FIG. 14) using the terminal ID of the destination terminal candidate as a search key, and extracts the operating status for each terminal ID. Thus, the extraction unit 54 can acquire the operating state of the destination terminal candidates that can talk with the request source terminal that has made the login request.

  Further, the extraction unit 54 searches the destination list management table (see FIG. 15) using the terminal ID of the request source terminal that has made the login request as a key, and registers the terminal ID of the request source terminal as a candidate for the destination terminal. The terminal IDs of other requesting terminals are also extracted. The extraction unit 54 also searches the terminal status management table (see FIG. 14) using the terminal ID as a search key, and obtains the operating status of the request source terminal that has issued the login request.

  Further, the extraction unit 54 extracts the IP address of the corresponding terminal 10 by searching the terminal status management table (see FIG. 14) using the terminal ID of the terminal 10 received by the transmission / reception unit 51 as a search key. Further, the extraction unit 54 extracts the corresponding communication method information by searching the terminal information management table (see FIG. 13) using the terminal ID of the terminal 10 received by the transmission / reception unit 51 as a search key. Further, the extraction unit 54 searches the conversion management table (see FIG. 17) using the terminal ID of the terminal 10 received by the transmission / reception unit 51 as a search key, thereby obtaining the IP address of the corresponding conversion system 80 and the received reception address. The IP address of the terminal 10 related to the terminal ID is extracted.

  Further, the extraction unit 54 extracts the image quality information of the corresponding image data by searching the quality management table (see FIG. 18) using the delay time information received by the transmission / reception unit 51 as a search key.

  Further, the extraction unit 54 extracts a corresponding terminal ID by searching the terminal status management table (see FIG. 14) using the IP address of the destination terminal as a search key.

  Subsequently, the determination unit 55 is implemented by a command from the CPU 201 illustrated in FIG. 8 and determines whether the communication method used by the terminal 10 is the communication method used by the dedicated terminal A. . The determining unit 55 determines whether the operating state indicated by the operating state information is “online”. Further, the determining unit 55 determines that the operating state information can be transmitted to the predetermined terminal 10 when it is determined to be “online”, and determines that it is not “online” when it is not “online”. 10, it is determined that the operation state information cannot be transmitted.

  The session management unit 56 is realized by an instruction from the CPU 201 shown in FIG. 8, and stores the relay device ID of the relay device 30 used for relaying the call data in the session management table (see FIG. 16) of the storage unit 5000. The terminal ID of the requesting terminal, the terminal ID of the destination terminal, the reception delay time (ms) when image data is received at the destination terminal, and the delay time information indicating the delay time are transmitted from the destination terminal. The received date and time received by the management system 50 are stored and managed in association with each other. In addition, the session management unit 56 creates a session ID used for establishing a communication session.

  The quality determining unit 57 determines the image quality of the image data to be relayed by the relay device 30 based on the image quality information of the image data extracted by the extracting unit 54.

  The delay time management unit 58 is realized by an instruction from the CPU 201 shown in FIG. 8, and is a record including the terminal ID extracted by the extraction unit 54 in the session management table of the session management DB 5005 (see FIG. 16). The delay time indicated by the above-mentioned delay time information is stored and managed in the field of the delay time in.

  The storage / read processing unit 59 is executed by the command from the CPU 201 shown in FIG. 8 and by the HDD 205 shown in FIG. 8, and stores various data in the storage unit 5000 or is stored in the storage unit 5000. A process of reading various data is performed.

<Functional configuration of conversion system>
The conversion system 80 includes a transmission / reception unit 81, a communication system conversion unit 82, and a storage / read processing unit 89. Each of these units has a function or a function realized by operating any one of the components shown in FIG. 8 by an instruction from the CPU 201 according to a program for the conversion system 80 expanded on the RAM 203 from the HD 204 or Means. In addition, the conversion system 80 includes a storage unit 8000 configured by the RAM 203 illustrated in FIG. 8 and / or the HD 204 illustrated in FIG. This storage unit 8000 stores conversion rule data used for converting communication data.

(Each functional configuration of the conversion system)
Next, each functional configuration of the conversion system 80 will be described in detail with reference to FIGS. 8 and 9. In the following, in describing each functional configuration of the conversion system 80, among the components illustrated in FIG. 8, a relationship with main components for realizing each functional configuration of the conversion system 80 will also be described. explain.

  The transmission / reception unit 81 of the conversion system 80 illustrated in FIG. 9 is realized by a command from the CPU 201 illustrated in FIG. 8 and the network I / F 209 illustrated in FIG. It sends and receives various data (or information) to and from other terminals, devices or systems. In addition, the transmission / reception unit 81 transmits session start instruction information for instructing start of a communication session (third communication session) to the destination indicated by the destination information transmitted by the relay device 30. The destination information is an IP address, a URI (Uniform Resource Identifier), or the like.

  The communication method conversion unit 82 converts the communication method of the call data transmitted from the request source terminal and the communication method of the call data transmitted from the destination terminal according to the conversion rule data of the communication method stored in the storage unit 8000. Convert.

  The storage / read processing unit 89 is executed by the command from the CPU 201 shown in FIG. 8 and by the HDD 205 shown in FIG. 8, and stores various data in the storage unit 8000 or is stored in the storage unit 8000. A process of reading various data is performed.

<< Process or Operation of Embodiment >>
Subsequently, a case where a call is made between two dedicated terminals A will be described with reference to FIGS. 6, 9, and 19 to 22. FIG. 19 is a sequence diagram showing a call start request.

  As shown in FIG. 19, first, when the user of the request source terminal (terminal 10aa) as the dedicated terminal A turns on the power switch 109 shown in FIG. The received operation input receiving unit 12 receives the power-on and turns on the power (step S21). Then, upon receiving the power-on, the login request unit 13 automatically transmits login request information indicating a login request from the transmission / reception unit 11 to the management system 50 via the communication network 2 (step S22). The login request information includes a terminal ID for identifying the terminal 10aa that is the request source terminal, and a password. The terminal ID and the password are data read from the storage unit 1000 via the storage / read processing unit 19 and sent to the transmission / reception unit 11. When the login request information is transmitted from the request source terminal (terminal 10aa) to the management system 50, the management system 50 on the receiving side can grasp the IP address of the terminal 10aa on the transmitting side.

  Next, the terminal authentication unit 52 of the management system 50 searches the terminal information management table (see FIG. 13) using the terminal ID and the password included in the login request information received via the transmission / reception unit 51 as search keys. Then, terminal authentication is performed by determining whether the same terminal ID and the same password are managed in the terminal information management table (step S23). Since the same terminal ID and the same password are managed by the terminal authentication unit 52, if it is determined that the request is a login request from the terminal 10 having valid use authority, the state management unit 53 For each record indicated by the terminal ID and the destination name of the terminal 10aa, the operating status, the reception date and time when the login request information was received, and the IP address of the terminal 10aa are stored in the terminal status management table (see FIG. 14) in association with each other. (Step S24). As a result, in the terminal status management table, the terminal ID “01aa”, the destination name, the operation status “online”, the reception date / time “2011.11.10.13:40”, and the terminal IP address “1.2.1. 3 "will be managed in association with each other.

  Then, the transmission / reception unit 51 of the management system 50 transmits the authentication result information indicating the authentication result obtained by the terminal authentication unit 52 via the communication network 2 to the request source terminal (terminal 10aa) requesting the login. (Step S25). In the present embodiment, a case in which the terminal authentication unit 52 determines that the terminal has a valid use right will be described below.

  When the request source terminal (terminal 10aa) receives the authentication result information indicating the result of the determination that the terminal has the valid use authority, the transmission / reception unit 11 transmits the destination to the management system 50 via the communication network 2. The destination list request information indicating that the list is requested is transmitted (step S26). Thereby, the transmission / reception unit 51 of the management system 50 receives the destination list request information.

  Next, the extraction unit 54 searches the destination list management table (see FIG. 15) using the terminal ID “01aa” of the request source terminal (terminal 10aa) that has made the login request as a search key, and searches for the request source terminal (terminal 10aa). A terminal ID of a destination terminal candidate that can make a call is extracted, and a terminal state management table (see FIG. 14) is searched using the terminal ID as a search key to extract corresponding destination name information (step S27). . Here, for the sake of simplicity, a case where the terminal IDs of the terminal 10ca as the dedicated terminal A and the terminal 10da as the non-dedicated terminal D are extracted as the destination terminal candidate terminals 10 will be described below. I do.

  Next, the extraction unit 54 reads the data of the destination list frame from the storage unit 5000 (Step S28). Then, the transmission / reception unit 51 transmits “destination list information (destination list frame, terminal ID, destination name)” including the destination list frame and the terminal ID and the destination name information extracted in step S27 to the request source terminal (terminal 10aa) (step S29). Thereby, in the request source terminal (terminal 10aa), the transmission / reception unit 11 receives the destination list information.

  Next, the storage / read processing unit 19 of the request source terminal (terminal 10aa) stores the destination list information in the storage unit 1000 (Step S30).

  As described above, in the present embodiment, instead of managing the destination list information in each terminal 10, the management system 50 centrally manages the destination list information of all the terminals. Therefore, a new terminal 10 is used in the call system 1, a new model terminal 10 is included in place of the terminal 10 already used, and the appearance of the destination list frame is changed. Even in such a case, since the management system 50 collectively responds, it is possible to save the trouble of changing the destination list information on each terminal 10 side.

  Further, the management system 50 extracts the operating state of the terminal 10 as a destination terminal candidate (step S31). Here, a specific process in step S31 will be described with reference to FIG. FIG. 20 is a flowchart showing the extraction of the operating state.

  First, the extraction unit 54 extracts the corresponding communication method information by searching the terminal information management table (see FIG. 13) based on the terminal ID of the destination terminal searched in step S27 (step S31-). 1).

  Next, the determination unit 55 determines whether or not the communication method indicated by the extracted communication method information is a communication method used by the request source terminal (terminal 10aa) as the dedicated terminal A (Step S10). S31-2). Specifically, the determination unit 55 determines whether the communication method indicated by the communication method information extracted by the extraction unit 54 is the same as the communication method used by the request source terminal (terminal 10aa). . The case where the communication system is the same is a case where both the call control system and the encoding system are the same, and the case where the communication system is not the same (different) is at least one of the call control system and the encoding system. Are different.

  If the determination unit 55 determines in step S31-2 that the communication methods are the same (YES), the extraction unit 54 further searches the terminal ID of the terminal 10 as a destination terminal candidate for a search key. The corresponding operating state information is extracted by searching the terminal state management table (see FIG. 14) (step S31-3). On the other hand, if the determination unit 55 determines in step S31-2 that the communication methods are not the same (different) (NO), the terminal state management table is not searched, and the processing in step S31 ends. .

  Next, the storage / readout processing unit 59 stores the management information in the storage unit 5000 in association with the operation status information extracted in step S31 and the terminal ID of the terminal 10 in the operation status indicated by the operation status information. (Step S32). If the operation state information is not extracted in step S31, the storage / read processing unit 59 replaces the operation state information indicating that the operation state is “unknown” with the operation state indicated by the operation state information. It is stored in the storage unit 5000 and managed in association with the terminal ID of the terminal 10 in the state.

  Next, the transmission / reception unit 51 includes the terminal ID “01ca” as the search key used in step S27 and the operation status “online (communicable)” of the corresponding destination terminal (terminal 10ca). The terminal status information is transmitted to the request source terminal (terminal 10aa) via the communication network 2 (step S33). Similarly, as part of step S32, the transmission / reception unit 51 transmits the remaining terminal information such as “terminal status information” including the terminal ID “01da” and the operating status “unknown” of the corresponding destination terminal (terminal 10da). The “terminal state information” is also transmitted individually to the request source terminal (terminal 10aa).

  Note that, instead of the operating status information indicating that the operating status is “unknown”, different communication mode information indicating that the communication mode used by the destination terminal is not the communication mode used by the request source terminal may be transmitted. . Further, when the management system 50 cannot acquire the operation status of the destination terminal candidate due to a disconnection in the middle of the communication network 2 or a failure of the destination terminal candidate terminal, the operation status indicating that the operation status is “offline” The status information is sent to the requesting terminal.

  Further, the transmission / reception unit 51 may transmit “terminal state information” indicating the terminal ID of the request source terminal (terminal 10aa) itself and the operating state to the request source terminal (terminal 10aa).

  Next, the storage / read processing unit 19 of the request source terminal (terminal 10aa) sequentially stores the terminal status information received from the management system 50 in the storage unit 1000 (Step S34). Therefore, the request source terminal (terminal 10aa) obtains the current operating status of the terminal 10ca, which is the dedicated terminal A that can talk with the request source terminal (terminal 10aa) by receiving the status information of each terminal. It is possible to acquire that the terminal 10da that can talk to the request source terminal (terminal 10aa) is the non-dedicated terminal D (the operation state is “unknown”).

  Next, the destination list creation unit 18 of the request source terminal (terminal 10aa) reflects the status of the terminal 10 as a destination candidate based on the destination list information stored in the storage unit 1000 and the status information of the terminal. In addition to creating the destination list, the display control unit 16 displays the destination list on the display 120aa shown in FIG. 1 (step S35). In order to reflect the state of the terminal 10 in the destination list, the following process is performed. That is, the destination list creation unit 18 extracts the corresponding visual information by searching the visual information management table (see FIG. 10) based on the terminal operating state information included in the terminal state information. Then, the destination list creating unit 18 assigns the extracted visual information to the destination list frame in the destination list information for each terminal ID and destination name in the destination list information.

  FIG. 21 is a conceptual diagram showing a destination list. As shown in FIG. 21, the destination list frame forming the destination list includes, from left to right, visual information indicating the operating state of each terminal 10 that is a destination terminal candidate, each terminal ID, and a terminal name. It is shown. Further, a scroll bar is displayed on the rightmost side of the destination list frame. By moving the scroll bar up and down, the visual information displayed in the destination list moves up and down.

  Returning to FIG. 19, in the management system 50, after the above-described step S33, the extraction unit 54 sets the destination list management table (see FIG. 19) based on the terminal ID “01aa” of the request source terminal (terminal 10aa) that made the login request. 15) to extract the terminal ID of another requesting terminal that has registered the terminal ID “01aa” of the requesting terminal (terminal 10aa) as a destination terminal candidate (step S36). Here, for the sake of simplicity, the following description is for the case where the terminal IDs extracted in step S36 are the terminal IDs of the terminals ba, 10ca, and 10da (“01ba”, “01ca”, “01da”). I will continue to explain.

  Next, the extraction unit 54 of the management system 50 searches the terminal status management table (see FIG. 14) using the terminal ID “01aa” of the request source terminal (terminal 10aa) that has sent the login request as a search key, The operation state of the request source terminal (terminal 10aa) that has made the login request is extracted (step S37).

  Next, for the terminal (10ba, 10ca, 10da) indicated by the terminal ID (“01ba”, “01ca”, “01da”) extracted in step S36, the latest of the requesting terminal (terminal 10aa) It is determined whether or not the terminal status information indicating the operating status can be transmitted (step S38). Here, a specific process in step S38 will be described with reference to FIG. FIG. 22 is a flowchart for determining whether or not transmission of the operating state is possible.

  First, the extraction unit 54 extracts the operating state information stored in the storage unit 5000 in step S32 and the corresponding terminal ID (step S38-1). Next, the determining unit 55 determines whether or not the operating state indicated by the operating state information extracted in step S38-1 is "online" (step S38-2). If it is determined in step S38-2 that the status is “online” (YES), the determination unit 55 transmits the operating status information of the request source terminal (terminal 10aa) extracted in step S38-1 to It is determined that transmission is possible to the destination terminal candidate (step S38-3).

  On the other hand, when it is determined in step S38-2 that the request is not “online” (NO), the determining unit 55 determines the operating state information of the request source terminal (terminal 10aa) extracted in step S38-1. Is determined not to be transmitted to the destination terminal candidate (step S38-3). The operating states other than “online” include “offline” and “unknown”. That is, the operation status information of the request source terminal (terminal 10aa) is not transmitted to the terminal 10ba that is the dedicated terminal A but is offline and the terminal da as the non-dedicated terminal D. Thus, the non-dedicated terminal D cannot receive the service of the operating state of the dedicated terminal A notified by the management system 50.

  Next, the transmitting / receiving unit 51 sets the terminal ID “01aa” of the request source terminal (terminal 10aa) and the request source terminal (terminal 10aa) for the terminal 10ca determined to be capable of transmitting the operation state information in step S38. Then, “terminal state information” including the operating state information indicating the operating state of the terminal is transmitted (step S39). Thereby, the transmission / reception unit of the terminal 10ca receives the terminal status information.

  Therefore, in the terminal 10ca, a destination list reflecting the latest operation state of the terminal 10aa is created and displayed on the display 120ca by the same processing as step S35 (step S40).

  Subsequently, a case where a call is made between two dedicated terminals A will be described with reference to FIGS. 6, 9, and 23 to 26. FIG. 23 is a sequence diagram showing a call start request.

  As shown in FIG. 23, first, the user of the request source terminal (terminal 10aa) as the dedicated terminal A presses the operation button 108 shown in FIG. When the destination terminal (terminal 10ca) is selected as A, the operation input receiving unit 12 shown in FIG. 9 receives a request to start a call with the destination terminal (terminal 10ca) (step S41). Then, the transmission / reception unit 11 of the request source terminal (terminal 10aa) transmits start request information indicating that the user wants to start a call to the management system 50 (step S42). The start request information includes the terminal ID “01aa” of the request source terminal (terminal 10aa) and the terminal ID “01ca” of the destination terminal (terminal 10ca).

  Then, the state management unit 53 of the management system 50 illustrated in FIG. 9 checks the terminal ID “01aa” of the request source terminal (terminal 10aa) and the terminal ID “01ca” of the destination terminal (terminal 10ca) included in the start request information. , In the terminal status management table (see FIG. 14), the operation status field portions of the records including the terminal ID “01aa” and the terminal ID “01ca” are both changed to “online (active)”. (Step S43). In this state, the request source terminal (terminal 10aa) and the destination terminal (terminal 10ca) have not started a call, but are in a call state, and the other terminals 10 are in the request source terminal (terminal 10aa) or the destination terminal. When an attempt is made to make a call with (terminal 10ca), a notification sound or display indicating a so-called busy state is output.

  Next, the session management unit 56 of the management system 50 creates a session ID used for establishing a communication session (Step S44). Then, the management system 50 determines what the communication method used by the destination terminal (terminal 10ca) is (Step S45).

  Here, step S45 will be described in detail with reference to FIG. FIG. 24 is a flowchart showing the determination of the communication method.

  As illustrated in FIG. 24, the extraction unit 54 searches the terminal information management table (see FIG. 13) based on the terminal ID “01ca” of the destination terminal (terminal 10ca) received by the transmission / reception unit 51. Thereby, the corresponding communication method information is extracted (step S45-1).

  Next, the determining unit 55 determines whether the communication method indicated by the extracted communication method information is a communication method used by the request source terminal (terminal 10aa) (Step S45-2). Specifically, the determination unit 55 determines whether the communication method indicated by the communication method information extracted by the extraction unit 54 is the same as the communication method used by the request source terminal (terminal 10aa). . The case where the communication system is the same is a case where both the call control system and the encoding system are the same, and the case where the communication system is not the same (different) is at least one of the call control system and the encoding system. Are different.

  If the determination unit 55 determines in step S45-2 that the communication method is the same (YES), the process proceeds to step S61 shown in FIG. 25 described below. Here, the destination terminal (terminal 10ca) is the same dedicated terminal A as the request source terminal (terminal 10aa). FIG. 25 is a sequence diagram showing a process for establishing a communication session before making a call between two dedicated terminals. In the present embodiment, a case will be described in which, among the plurality of relay devices 30, the relay device 30a connected to the same LAN 2a as the request source terminal (terminal 10aa) is used.

  As shown in FIG. 25, the management system 50 transmits session initialization request information indicating that the communication session established by the relay device 30a is initialized from the transmission / reception unit 51 to the relay device 30a. (Step S61). The session initialization request information includes the session ID created in step S44, the request source terminal (terminal 10aa) and the destination terminal (terminal 10ca) managed in the terminal state management table (see FIG. 14). ) Are included. When transmitting the session initialization request information to the relay device 30a, the management system 50 also transmits the IP address of the management system 50. Thereby, the transmission / reception unit 31 of the relay device 30a receives the session initialization request information and the IP address of the management system 50.

  Next, the transmission / reception unit 31 of the relay device 30a initializes a communication session (step S62). Then, the transmission / reception unit 31 transmits session start instruction information indicating an instruction to start a communication session to the request source terminal (terminal 10aa) (step S63). The session start instruction information includes the session ID sent from the management system 50. When transmitting the session start instruction information to the request source terminal (terminal 10aa), the relay device 30a also transmits the IP address of the relay device 30a. Thereby, the transmitting / receiving unit 11 of the request source terminal (terminal 10aa) receives the session start instruction information and the IP address of the relay device 30a.

  Similarly, the transmission / reception unit 31 transmits session start instruction information indicating an instruction to start a communication session to the destination terminal (terminal 10ca) (step S64). The session start instruction information includes the session ID sent from the management system 50. When transmitting the session start instruction information to the destination terminal (terminal 10ca), the relay device 30a also transmits the IP address of the relay device 30a. Thereby, the transmission / reception unit 11 of the destination terminal (terminal 10ca) receives the session start instruction information and the IP address of the relay device 30a.

  As described above, based on step S63, a communication session (first communication session sed1 shown in FIG. 2) for transmitting and receiving call data is established between the request source terminal (terminal 10aa) and relay device 30a. (Step S65-1). Further, based on the above step S64, a communication session (second communication session sed2 shown in FIG. 2) for transmitting and receiving call data is established between the relay device 30a and the destination terminal (terminal 10ca) (FIG. 2). Step S65-2).

  Next, a process of transmitting and receiving call data to make a call such as a video conference between the request source terminal and the destination terminal will be described with reference to FIG. FIG. 26 is a sequence diagram showing a process of transmitting and receiving call data between two dedicated terminals. The one-way process of transmitting call data from the terminal 10aa to the terminal 10ca and the reverse process of transmitting call data from the terminal 10ca to the terminal 10aa make it possible to transmit and receive call data and detect a delay time described later. Since the processing is the same, the one-way communication will be described, and the reverse communication will be omitted.

  First, the request source terminal (terminal 10aa) transmits the image data of the subject imaged by the imaging unit 14 and the sound data of the sound input by the sound input unit 15a from the transmission / reception unit 11 using the communication session sed1. The data is transmitted to the relay device 30a via the communication network 2 (step S81). In the present embodiment, high-quality image data and sound data composed of the three components of low resolution, medium resolution, and high resolution shown in FIG. 3 are transmitted. As a result, in the relay device 30a, the transmission / reception unit 31 receives the image data and the sound data of the three resolutions. Then, the data quality checking unit 33 searches the changed quality management table (see FIG. 11) using the IP address “1.3.1.3” of the destination terminal (terminal 10ca) as a search key, and the corresponding image to be relayed. The quality of the image of the image data to be relayed is confirmed by extracting the image quality of the data (step S82). In the present embodiment, since the image quality of the confirmed image data is “high image quality” and is the same as the image quality of the image data received by the transmission / reception unit 31, the relay device 30a uses the communication session sed2 and The image data having the image quality of (1) and the sound data having the same sound quality are transferred to the destination terminal (terminal 10ca) (step S83). As a result, the destination terminal (terminal 10ca) receives, with the transmission / reception unit 11, high-quality image data and sound data including three resolutions of low resolution, medium resolution, and high resolution. Then, the display control unit 16 can combine the three image quality image data to display an image on the display 120, and the sound output unit 15b can output a sound based on the sound data.

  Next, the delay detection unit 17 of the destination terminal (terminal 10ca) detects a delay time of the reception of the image data received by the transmission / reception unit 11 at regular intervals (for example, every one second) (step S84). In the present embodiment, the case where the delay time is 200 (ms) will be described below.

  The transmission / reception unit 11 of the destination terminal (terminal 10ca) transmits the delay time indicating the delay time “200 (ms)” to the management system 50 via the communication network 2 by the management communication session sei shown in FIG. The information is transmitted (step S85). Thereby, the management system 50 can recognize the delay time and the IP address “1.3.1.3” of the terminal 10ca that is the transmission source of the delay time information.

  Next, the delay time management unit 58 of the management system 50 searches the terminal status management table (see FIG. 14) using the IP address “1.3.1.3” of the destination terminal (terminal 10ca) as a search key. Then, the corresponding terminal ID “01ca” is extracted, and further, in the session management table (see FIG. 16), the field of the delay time in the record of the terminal ID “01ca” is indicated by the delay time information. The delay time “200 (ms)” is stored and managed (step S86).

  Next, the quality determining unit 57 searches the quality management table (see FIG. 18) using the delay time “200 (ms)” as a search key, and extracts the image quality “medium image quality” of the corresponding image data. , The image quality is determined to be “medium image quality” (step S87).

  Next, the transmission / reception unit 51 searches the relay device management table (see FIG. 12) in the session management table (see FIG. 16) by using the relay device ID “111a” associated with the terminal ID “01ca” as a search key. Then, the IP address “1.2.1.2” of the corresponding relay device 30a is extracted (step S88). Then, the transmission / reception unit 51 transmits the quality information indicating the image quality “medium image quality” of the image data determined in step 87 to the relay device 30a via the communication network 2 via the management communication session sei (step S107). S89). The quality information includes the IP address “1.3.1.3” of the destination terminal (terminal 10ca) used as the search key in step S86. Thus, in the relay device 30a, the change quality management unit 34 stores the IP address “1.3.1.3” of the destination terminal 10 (here, the terminal 10ca) in the change quality management table (see FIG. 11). , And the image quality “medium image quality” of the image data to be relayed are stored and managed (step S90).

  Next, the request source terminal (terminal 10aa) continues to the relay device 30a in the first communication session sed1 in the same manner as in step S81, and sends a high-quality image composed of three low-resolution, medium-resolution, and high-resolution images. The data and the sound data are transmitted (step S91). As a result, in the relay device 30a, as in step S82, the data quality confirmation unit 33 uses the IP address “1.3.1.3” of the destination terminal (terminal 10ca) as a search key and a change quality management table ( (See FIG. 11), and the image quality of the relayed image data is confirmed by extracting the image quality “medium image quality” of the corresponding relayed image data (step S92). In the present embodiment, the image quality of the confirmed image data is “medium image quality”, which is lower than the image quality “high image quality” of the image data received by the transmission / reception unit 31, so that the data quality change unit 35 By changing the image quality of the image data from “high image quality” to “medium image quality”, the image quality of the image data is changed (step S93).

  Then, the transmission / reception unit 31 transmits the image data whose image quality has been changed to “medium image quality” and the sound quality of the sound to the destination terminal (terminal 10ca) via the communication network 2 in the second communication session sed2. The sound data that has not been changed is transmitted (step S94). As a result, the destination terminal (terminal 10ca) receives, with the transmission / reception unit 11, medium-quality image data and sound data including two low-resolution and medium-resolution images. Then, the display control unit 16 can combine the image data of the two resolutions to display an image on the display 120ca, and the sound output unit 15b can output a sound based on the sound data.

  As described above, when the reception delay occurs at the destination terminal (terminal 10ca) that receives the image data, the relay device 30a changes the image quality, and the user participating in the call such as the video conference. Can be prevented from giving a sense of incongruity. That is, between the two dedicated terminals A, a service for coping with a delay in receiving image data can be received.

  Subsequently, using FIG. 24, FIG. 27 to FIG. 29, a second communication in which a call is made between the dedicated terminal A (an example of the first call terminal) and the non-dedicated terminal D (an example of the second call terminal) The communication pattern will be described. Specifically, a call is made between the terminal 10aa as the dedicated terminal A and the terminal 10da as the non-dedicated terminal D. In the present embodiment, the communication method used by the terminal 10aa is that the call control method is an instant messenger protocol (or a protocol that is an extension of the instant messenger protocol), the encoding method is SVC, and the terminal 10da uses the communication method. The communication system used will be described in the case where the call control system is SIP and the encoding system is AVC.

  19 and 23, in the first communication pattern and the second communication pattern, the selection of the destination in step S41 is changed from the destination terminal (terminal 10ca) to the destination terminal (terminal 10da). The only difference is the terminal ID of the destination terminal used for transmission / reception and search according to, so that the description thereof is omitted. Then, a description will be given from the case where the determination unit 55 determines that the communication method is not the same (different) (NO) in step S45-2 illustrated in FIG. 24.

  In the case of the second communication pattern, the extraction unit 54 searches the conversion management table (see FIG. 17) based on the terminal ID “01da” of the destination terminal (terminal 10da) received by the transmission / reception unit 51. Then, the IP address “1.3.2.2” of the corresponding conversion system 80 and the IP address “1.3.2.3” of the destination terminal (terminal 10da) are extracted (step S45-3). Then, the process proceeds to step S101 shown in FIG.

  FIG. 27 is a sequence diagram showing a process for establishing a communication session before making a call between the dedicated terminal A and the non-dedicated terminal D. As shown in FIG. 27, the management system 50 transmits session initialization request information indicating that the communication session established by the relay device 30a is initialized from the transmission / reception unit 51 to the relay device 30a. (Step S101). The session initialization request information includes the session ID and the IP addresses of the request source terminal (terminal 10aa), the conversion system 80, and the destination terminal (terminal 10da). Among them, the session ID is the ID created in step S44. The IP address of the request source terminal (terminal 10aa) is managed in a terminal status management table (see FIG. 14). Furthermore, each IP address of the conversion system 80 and the destination terminal (terminal 10da) is the IP address extracted in step S45-3.

  When transmitting the session initialization request information to the relay device 30a, the management system 50 also transmits the IP address of the management system 50. Thereby, the transmission / reception unit 31 of the relay device 30a receives the session initialization request information and the IP address of the management system 50.

  Next, the transmission / reception unit 31 of the relay device 30a initializes a communication session (step S102). Then, the transmission / reception unit 31 transmits session start instruction information indicating an instruction to start a communication session to the request source terminal (terminal 10aa) (step S103). The session start instruction information includes the session ID sent from the management system 50. When transmitting the session start instruction information to the request source terminal (terminal 10aa), the relay device 30a also transmits the IP address of the relay device 30a. Thereby, the transmitting / receiving unit 11 of the request source terminal (terminal 10aa) receives the session start instruction information and the IP address of the relay device 30a.

  Similarly, the transmission / reception unit 31 transmits session start instruction information indicating an instruction to start a communication session to the conversion system 80 (step S104). The session start instruction information includes the session ID and the destination terminal (terminal 10da) IP address sent from the management system 50. That is, the transmitting and receiving unit 31 transmits the session start instruction information and the destination terminal (terminal 10da) IP address. Further, when transmitting the session start instruction information to the conversion system 80, the relay device 30a also transmits the IP address of the relay device 30a. As a result, the transmission / reception unit 81 of the conversion system 80 receives the session start instruction information and the IP address of the relay device 30a.

  Further, in the second communication pattern, the transmission / reception unit 81 of the conversion system 80 transmits session start instruction information indicating an instruction to start a communication session to the destination terminal (terminal 10da) (step S105). The session start instruction information includes the session ID sent from the management system 50. When transmitting the session start instruction information to the destination terminal (terminal 10da), conversion system 80 also transmits the IP address of conversion system 80. As a result, the transmission / reception unit 11 of the destination terminal (terminal 10da) receives the session start instruction information and the IP address of the conversion system 80.

  As described above, a communication session (first communication session sed11 shown in FIG. 4) for transmitting and receiving call data is established between the request source terminal (terminal 10aa) and relay device 30a based on step S103. (Step S106-1). Also, based on step S104, a communication session (second communication session sed12 shown in FIG. 4) for transmitting and receiving call data is established between relay device 30a and conversion system 80 (step S106-). 2). Further, based on step S105, a communication session (third communication session sed13 shown in FIG. 4) for transmitting and receiving call data is established between conversion system 80 and the destination terminal (terminal 10da). (Step S106-3).

  Subsequently, a process of transmitting and receiving call data to make a call such as a video conference between the request source terminal and the destination terminal will be described with reference to FIG. FIG. 28 is a sequence diagram showing a process for transmitting and receiving call data between the dedicated terminal A and the non-dedicated terminal D.

  First, the request source terminal (terminal 10aa) transmits the image data of the subject imaged by the imaging unit 14 and the sound data of the sound input by the sound input unit 15a to the transmission / reception unit 11 using the communication session sed11. The data is transmitted to the relay device 30a via the communication network 2 (step S121). In the second communication pattern, similarly to the first communication pattern, high-quality image data including low resolution, medium resolution, and high resolution shown in FIG. Sending. As a result, in the relay device 30a, the transmission / reception unit 31 receives the image data and the sound data of the three resolutions.

  Next, using the communication session sed12, the relay device 30a transmits the above three high-quality image data and sound data from the transmission / reception unit 31 to the conversion system 80 via the communication network 2 (step S122). ). As a result, in the conversion system 80, the transmission / reception unit 81 receives the image data and the sound data of the three resolutions.

  Next, the communication system conversion unit 82 of the conversion system 80 uses the image data of the three resolutions in the request source terminal (terminal 10aa) based on the conversion rule data stored in the storage unit 8000 in advance. The communication method used is converted to the communication method used by the destination terminal (terminal 10da) (step S123). Here, along with the conversion of the communication method, the image data of the three resolutions (high resolution, medium resolution, and low resolution) shown in FIG. 3 is converted into one resolution (medium resolution) shown in FIG. Is converted to image data.

  Next, using the communication session sed13, the conversion system 80 transmits sound data and medium-resolution image data from the transmission / reception unit 81 to the terminal 10da via the communication network 2 (step S124). As a result, in the destination terminal (terminal 10da), the transmission / reception unit 11 receives the sound data and the medium-resolution image data.

  On the other hand, when the image data and the sound data are transmitted from the destination terminal (terminal 10da) to the request source terminal (terminal 10aa), the destination terminal (terminal 10da) transmits the communication session sed13 as shown in FIG. The sound data and the medium-resolution image data are transmitted from the transmission / reception unit 11 to the conversion system 80 via the communication network 2 by using (step S125). Thus, in the conversion system 80, the transmission / reception unit 81 receives the sound data and the medium-resolution image data.

  Next, the communication system conversion unit 82 of the conversion system 80 uses the sound data and the medium resolution image data at the destination terminal (terminal 10da) based on the conversion rule data stored in the storage unit 8000 in advance. The communication method used is converted to the communication method used by the request source terminal (terminal 10aa) (step S126).

  FIG. 29 is a conceptual diagram showing the image quality of image data converted by the conversion system. In step S126, with the conversion of the communication method, the image data of one resolution (medium resolution) shown in FIG. 5 is replaced with the low-resolution image data shown in FIG. The image data is converted into the medium resolution image data shown in FIG. 29C and the low intermediate resolution image data which is an intermediate resolution between the middle resolution and the low resolution as shown in FIG. That is, even if the medium resolution image data is sent from the destination terminal (terminal 10da) which is the non-dedicated terminal D, the conversion system 80 converts the image data into the high resolution image data sent in step S122. And the medium resolution image data transmitted from the destination terminal (terminal 10da) becomes the maximum resolution, and three images of the medium resolution, the middle resolution between the middle resolution and the low resolution, and the low resolution Converted to data.

  Next, using the communication session sed12, the conversion system 80 transmits sound data and image data of three resolutions from the transmission / reception unit 81 to the relay device 30a via the communication network 2 (step S127). Thereby, in the relay device 30a, the transmission / reception unit 31 receives the sound data and the image data of three resolutions. Then, using the communication session sed11, the relay device 30a transmits sound data and image data of three resolutions from the transmission / reception unit 31 to the request source terminal (terminal 10aa) via the communication network 2 (step S128). Thereby, in the request source terminal (terminal 10aa), the transmission / reception unit 11 receives the sound data and the image data of three resolutions.

<< Main effects of the present embodiment >>
As described above, according to the present embodiment, when the communication method used by the destination terminal as the non-dedicated terminal D is not the communication method used by the request source terminal as the dedicated terminal A, the management system Reference numeral 50 denotes operation status information indicating to the request source terminal that the operation status of the destination terminal is unknown, or different communication indicating that the communication method used by the destination terminal is not the communication method used by the request source terminal. Send method information. This allows the user on the requesting terminal side to understand that the operating status of the destination terminal cannot be acquired because the communication method of the destination terminal is different, so it is confusing as to whether to wait or perform the call start processing. Can be solved.

<< Supplement to the embodiment >>
In the above, the request source terminal or the dedicated terminal A has been described as an example of the first communication terminal, and the destination terminal or the non-dedicated terminal D has been described as an example of the second communication terminal. However, the present invention is not limited to this. The destination terminal or the non-dedicated terminal D may be an example of one communication terminal, and the request source terminal or the dedicated terminal A may be an example of the second communication terminal.

  Further, the call data is an example of communication data. The communication data includes text and image file data. The call terminal 10 is an example of a communication terminal. The communication terminal includes, for example, an information processing terminal that transmits and receives the file data, in addition to a terminal that performs a call. Further, the call management system 50 is an example of a communication management system. This communication management system includes, for example, a file management system that manages the processing of the file data, in addition to the system that manages the call. Furthermore, the communication system 1 is an example of a communication system. This communication system is constructed by the communication terminal and the communication management system.

  Further, the relay device 30, the management system 50, the conversion system 80, the program providing system 90, and the maintenance system 100 in the above embodiment may be constructed by a single computer, or may divide each unit (function or means). And may be constructed by a plurality of computers arbitrarily assigned. Further, when the program providing system 90 is constructed by a single computer, the program transmitted by the program providing system 90 may be divided into a plurality of modules and transmitted, or may not be divided. It may be transmitted. Further, when the program providing system 90 is configured by a plurality of computers, the plurality of modules may be divided and transmitted from each computer.

  Further, a recording medium such as a CD-ROM in which each program of the above-described embodiment is stored, an HD 204 in which these programs are stored, and a program providing system 90 including the HD 204 are all program products. , Can be provided domestically or abroad.

  Further, in the above-described embodiment, the change quality management table shown in FIG. 11 and the quality management table shown in FIG. Although management is performed by focusing on the resolution of the data image, the present invention is not limited to this. As another example of the quality, the management may be performed by focusing on the depth of image quality of the image data, the sampling frequency of the sound of the sound data, the bit length of the sound of the sound data, and the like. Further, sound data may be divided into data of three resolutions (high resolution, medium resolution, and low resolution) and transmitted and received.

  Further, in FIGS. 12, 14, and 16, the reception date and time are managed, but the present invention is not limited to this, and at least the reception time in the reception date and time may be managed.

  Further, in the above embodiment, the IP address of the relay device is managed in FIG. 12 and the IP address of the terminal is managed in FIG. 14. However, the present invention is not limited to this. In order to specify the relay device 30 on the communication network 2, Or destination information for identifying the terminal 10 on the communication network 2, each FQDN (Fully Qualified Domain Name) may be managed. In this case, an IP address corresponding to the FQDN is acquired by a well-known DNS (Domain Name System) server.

  Further, in the above embodiment, the case of the video conference system has been described as an example of the telephone system 1. However, the present invention is not limited to this, and a telephone system such as an IP (Internet Protocol) telephone or an Internet telephone may be used. . Further, the communication system 1 may be a car navigation system. In this case, for example, one of the terminals 10 corresponds to a car navigation device mounted on a car, and the other of the terminals 10 is mounted on a management terminal or a management server of a management center for managing car navigation, or mounted on another car. Car navigation device. Further, the call system 1 may be a communication system of a mobile phone. In this case, for example, the terminal 10 corresponds to a mobile phone.

  In the above embodiment, the image data and the sound data have been described as examples of the call data. However, the present invention is not limited to this, and may be touch data. In this case, the feeling of the user touching at one terminal is called to the other terminal. Further, the call data may be smell data. In this case, the smell of one terminal is called to the other terminal. The call data may be at least one of image data, sound data, tactile data, and olfactory data.

  Further, in the above-described embodiment, the case where the video conference is held by the communication system 1 has been described. However, the present invention is not limited to this, and a meeting, a general conversation between family members and friends, or a one-way communication of information is performed. It may be used for presentation.

1 call system (an example of a communication system)
10. Call terminal (an example of a communication terminal)
11 transmitting / receiving unit 16 display control unit (an example of display control means)
18. Destination list creation unit (an example of a destination list creation unit)
30 relay device 50 call management system (example of communication management system)
51 Transmission / Reception Unit (Example of Transmission Unit, Example of Reception Unit)
54 Extraction unit (an example of extraction means)
55 Judgment Unit (Example of Judgment Means)
80 conversion system 81 transmission / reception unit 82 communication system conversion unit (an example of a conversion unit)
90 program providing system 100 maintenance system 1000 storage unit 1001 visual information management DB (an example of visual information management means)
3000 storage unit 3001 change quality management DB
5000 storage unit (an example of storage means)
5001 Relay device management DB
5002 Terminal information management DB (an example of terminal information management means)
5003 Terminal status management DB (an example of terminal status management means)
5004 Destination list management DB (an example of destination list management means)
5005 Session management DB
5006 Conversion management DB
5007 Quality Management DB
8000 storage unit

JP 2008-227577 A JP-A-2004-304241

Claims (13)

In a communication management system that manages a plurality of communication terminals that transmit and receive predetermined communication data,
For each piece of identification information for identifying each of the plurality of communication terminals, terminal information management means for managing communication method information indicating a communication method used in each of the communication terminals,
A destination list that manages, for each piece of identification information for identifying a requesting terminal that requests communication start among the plurality of communication terminals, identification information for identifying a destination terminal with which the requesting terminal can communicate. Management means;
From the requesting terminal, receiving means for receiving identification information of the requesting terminal,
Based on the received identification information of the request source terminal, by searching the destination list management means, to extract the identification information of the corresponding destination terminal, based on the identification information of the extracted destination terminal, Extracting means for extracting the corresponding communication method information by searching the terminal information management means,
Determining means for determining whether or not the communication method indicated by the extracted communication method information is a communication method used by the requesting terminal;
When the determination unit determines that the communication method is not the communication method used by the request source terminal, the identification information of the extracted destination terminal and the operation state of the destination terminal are unknown to the request source terminal. Transmitting means for transmitting operation state information indicating that the communication method is different from the communication method used by the requesting terminal,
A communication management system comprising: The communication management system according to claim 1, further comprising:
For each identification information of the communication terminal, has a terminal state management means for managing operation state information indicating the operation state of the communication terminal,
When the determining unit determines that the communication method is used by the request source terminal, the extracting unit determines the terminal state managing unit based on the identification information of the destination terminal extracted by the extracting unit. By extracting the corresponding operating status information,
The communication management system according to claim 1, wherein the transmission unit transmits the identification information of the extracted destination terminal and operating state information corresponding to the identification information to the request source terminal. The communication method is indicated by a call control method for connecting or disconnecting with the destination of the communication, and an encoding method for converting the communication data into IP packets,
When at least one of the call control system and the encoding system is different, the determining unit determines that the communication system indicated by the communication system information extracted by the extracting unit is a communication system used by the request source terminal. The communication management system according to claim 1, wherein it is determined that the communication management system is not the one. The terminal state management means, for each identification information of the communication terminal, manages terminal name information indicating the name of the communication terminal,
4. The communication management system according to claim 2, wherein the transmission unit transmits the identification information of the extracted destination terminal and terminal name information corresponding to the identification information to the request source terminal. 5. A communication system comprising the communication management system according to claim 1 and the request source terminal,
The requesting terminal is:
First visual information that visually indicates that the communication method used by the destination terminal is the communication method used by the request source terminal, and the communication method used by the destination terminal is Visual information management means for visually indicating that the communication method is not used, and managing second visual information visually different from the first visual information;
When the identification information of the destination terminal and the operating status information of the destination terminal are received from the communication management system, the first visual information is extracted from the visual information management unit, and the communication management system When receiving the identification information of the destination terminal, and the operating state information indicating that the operating state of the destination terminal is unknown or the different communication method information, extracting the second visual information from the visual information managing means. Destination list creating means for creating a destination list reflecting the first or second visual information;
A communication system comprising: The first visual information includes visual information that is visually different for each operation state information of the destination terminal,
The destination list creating unit searches the visual information managing unit based on the operating state information received from the communication management system, extracts corresponding visual information, and creates the destination list. The communication system according to claim 5, wherein   The communication system according to claim 6, wherein each of the visual information included in the first visual information and the second visual information are icons in different forms. In a communication management method executed by a communication management system that manages a plurality of communication terminals that transmit and receive predetermined communication data,
The communication management system includes:
For each piece of identification information for identifying each of the plurality of communication terminals, terminal information management means for managing communication method information indicating a communication method used in each of the communication terminals,
A destination list that manages, for each piece of identification information for identifying a requesting terminal that requests communication start among the plurality of communication terminals, identification information for identifying a destination terminal with which the requesting terminal can communicate. Management means;
Has,
The communication management system includes:
A receiving step of receiving identification information of the requesting terminal from the requesting terminal;
By searching the destination list management means based on the received identification information of the request source terminal, the identification information of the corresponding destination terminal is extracted, and the terminal information is extracted based on the identification information of the destination terminal. An extracting step of extracting corresponding communication method information by searching for the management means;
A determining step of determining whether the communication method indicated by the extracted communication method information is a communication method used in the request source terminal;
When it is determined by the determining step that the communication method is not the communication method used by the requesting terminal, the identification information of the extracted destination terminal and the operating state of the destination terminal are unknown to the requesting terminal. A transmission step of transmitting operation state information indicating that the communication method is different from the communication method used by the requesting terminal,
A communication management method. The communication management method according to claim 8, further comprising:
The communication management system includes, for each piece of identification information of the communication terminal, a terminal state management unit that manages operation state information indicating an operation state of the communication terminal,
When it is determined by the determining step that the communication method is used by the request source terminal, the extracting step includes determining the terminal state managing means based on the identification information of the destination terminal extracted by the extracting step. Extracting the corresponding operating status information by searching for
The transmission step includes transmitting, to the request source terminal, the identification information of the extracted destination terminal and operating state information corresponding to the identification information. The communication method is indicated by a call control method for connecting or disconnecting with the destination of the communication, and an encoding method for converting the communication data into IP packets,
When at least one of the call control method and the encoding method is different, the determining step determines that the communication method indicated by the communication method information extracted in the extracting step is a communication method used in the request source terminal. The communication management method according to claim 8, further comprising determining that the communication management is not performed. The terminal state management means, for each identification information of the communication terminal, manages terminal name information indicating the name of the communication terminal,
The communication according to claim 9, wherein the transmitting step includes transmitting, to the request source terminal, the identification information of the extracted destination terminal and terminal name information corresponding to the identification information. Management method.   A program for causing a computer to execute each step according to any one of claims 8 to 11.   A maintenance system for performing maintenance of the communication management system according to claim 1.