JP6519642B2 - Terminal, display method, and program - Google Patents

Description

  The present invention relates to an invention for activating any one of a plurality of call functions of different call modes.

  2. Description of the Related Art In recent years, in response to a request for reducing business trip expenses and business trip time, a call system for conducting a video conference etc. via a communication network such as the Internet has become widespread. By using such a call system, transmission and reception of image data and voice data can be performed between a plurality of call terminals, and a video conference can be performed (see Patent Document 1).

  On the other hand, one call terminal is equipped with two kinds of call functions using two different communication methods such as PDC (Personal Digital Cellular) method and PHS (Personal Handyphone System), and these two communication methods are A video telephone system for making a call by switching is proposed (see Patent Document 2).

  However, the two conventional communication methods differ in both the destination of the call, the call control method for connecting or disconnecting, and the encoding method for encoding the call data. That is, in the conventional call terminal, two types of call functions using totally different communication methods are mounted in one case, and only one function is operated exclusively. Therefore, there is a problem that it is not possible to properly use a plurality of types of call functions using communication methods in which the call control method is the same and the encoding method is different.

The invention according to claim 1 is a second communication function different from the first communication function of communicating video data encoded by the first video encoding method with another terminal and the first video encoding method. A terminal having a second communication function for communicating video data encoded according to a video encoding method with another terminal, and associating with the identification information destination candidates and status information to which the video data is to be communicated. After logging in to the management system to be managed based on the identification information, accepting means for accepting selection of the first communication function or the second communication function from the user, and selection of the first communication function are accepted. In the case where the first communication function is activated, or when the selection of the second communication function is accepted, activation means for activating the second communication function, and the second communication function The choice is In order to update status information indicating online associated with the identification information managed in the management system, the status information indicating that the second communication function is being activated is transmitted in the case where the second communication function is activated. Transmitting means, and receiving means for receiving from the management system identification information corresponding to the destination candidate and status information associated with the identification information when the selection of the first communication function is accepted; Display control means for causing a display means to display a destination candidate having the first communication function and the second communication function based on identification information corresponding to the destination candidate, the display control means comprising When the destination candidate activates the first communication function, the first visual information is displayed in association with the destination candidate based on state information indicating online, and the destination is displayed. When the complement activates the second communication function, the second visual information is visually different from the first visual information based on state information indicating that the second communication function is activated. Visual information is displayed in association with the destination candidate, and among the destination candidates displayed on the display unit, the destination candidate displayed in association with the first visual information and the first communication function are used It is a terminal characterized by starting communication.

  As described above, according to the present invention, it is possible to selectively use a plurality of types of call functions using communication methods in which the call control method is the same and the encoding method is different.

FIG. 1 is a schematic view of a call system according to an embodiment of the present invention. It is a conceptual diagram which shows the communication condition in the case of implement | achieving a telephone call between the communication terminals which have a dedicated terminal function. It is a conceptual diagram which shows the image quality of the image data transmitted / received by the specification of SVC in FIG. It is the conceptual diagram which showed the communication condition in the case of implement | achieving a telephone call between the call terminals which have a non-dedicated terminal function. FIG. 5 is a conceptual diagram showing the image quality of image data transmitted and received according to the AVC standard in FIG. 4; It is an external view of the telephone terminal concerning this embodiment. It is a hardware block diagram of the call terminal which concerns on this embodiment. It is a hardware block diagram of the call management system which concerns on this embodiment, a relay apparatus, a program provision system, or a maintenance system. BRIEF DESCRIPTION OF THE DRAWINGS It is a functional block diagram of the telephone terminal which comprises a part of telephone system of embodiment, a relay apparatus, and a telephone call management system. It is a conceptual diagram which shows a visual information management table. It is a conceptual diagram which shows a relay apparatus management table. It is a conceptual diagram which shows a terminal authentication management table. It is a conceptual diagram which shows a terminal state management table. It is a conceptual diagram which shows a destination list management table. It is a conceptual diagram which shows a session management table. It is a sequence diagram which shows the process of the preparation phase which starts a telephone call between terminals. It is the flowchart which showed the process which selects a dedicated terminal function or a non-dedicated terminal function. It is a conceptual diagram which shows a telephone call function selection screen. It is the flowchart which showed the processing which indicates the address list. It is a conceptual diagram showing a destination list. It is a conceptual diagram which shows the other example of a function selection screen. It is a conceptual diagram which shows the other example of a destination list | wrist.

  Hereinafter, one embodiment of the present invention will be described with reference to FIGS.

<< Whole Configuration of Embodiment >>
FIG. 1 is a schematic view of a call system according to an embodiment of the present invention. As shown in FIG. 1, the call system 1 includes a plurality of call terminals (10aa, 10ab,...), Displays (120aa, 120ab,...) For each call terminal (10aa, 10ab,. The relay apparatus (30 a, 30 b, 30 c), the call management system 50, the program providing system 90, and the maintenance system 100 are constructed. Communication of image data and sound data as an example of call data is performed by the call system 1, whereby a video conference or the like between remote places can be realized. The plurality of routers (70a, 70b, 70c, 70d, 70ab, 70cd) select the optimum route of the call data.

  The call terminals (10aa, 10ab, 10ac,...), The relay device 30a, and the router 70a are communicably connected by the LAN 2a. The call terminals (10ba, 10bb, 10bc,...), The relay device 30b, and the router 70b are communicably connected by the LAN 2b. The LAN 2a and the LAN 2b are communicably connected by a dedicated line 2ab including a router 70ab. Furthermore, the LAN 2a, the LAN 2b, and the dedicated line 2ab are constructed in a predetermined area X. For example, the region X is Japan, the LAN 2a is built in an office in Tokyo, and the LAN 2b is built in an office in Osaka.

  On the other hand, the call terminals (10ca, 10cb, 10cc,...), The relay device 30c, and the router 70c are communicably connected by the LAN 2c. The call terminals 10d (10da, 10db, 10dc,...), The relay device 30d, and the router 70d are communicably connected by the LAN 2d. The LAN 2 c and the LAN 2 d are communicably connected by a dedicated line 2 cd including a router 70 cd. Furthermore, the LAN 2c, the LAN 2d, and the dedicated line 2cd are constructed in a predetermined area Y. For example, Region Y is the United States, LAN2c is built in a New York office, and LAN2d is Washington D.W. C. It is built in the office of The area X and the area Y are communicably connected from the routers (70ab and 70cd) via the Internet 2i.

  In the following, the “call terminal” is simply represented as a “terminal”, and the “call management system” is simply represented as a “management system”. Further, any of the plurality of terminals (10aa, 10ab, ...) is represented as "terminal 10", and any of the plurality of displays (120aa, 120ab, ...) is represented as "display 120" Among the plurality of relay devices (30a, 30b, 30c), any relay device is represented as "the relay device 30". Furthermore, a terminal as a request source requesting the start of a video conference is represented as a "request source terminal", and a terminal as a request destination (relay destination) is represented as a "destination terminal". Further, any of the routers (70a, 70b, 70c, 70d, 70ab, 70cd) is represented as "router 70".

  Further, the management system 50, the program providing system 90, and the maintenance system 100 are connected to the Internet 2i. The management system 50, the program providing system 90, and the maintenance system 100 may be installed in the area X or the area Y, or may be installed in areas other than these.

  Further, in the present embodiment, the communication network 2 of the present embodiment is constructed by the LAN 2a, the LAN 2b, the dedicated line 2ab, the Internet 2i, the dedicated line 2cd, the LAN 2c, and the LAN 2d. The communication network 2 may have a portion where wireless communication such as WiFi (Wireless Fidelity) or Bluetooth (registered trademark) is performed as well as wired communication.

  Also, in FIG. 1, four sets of numbers shown under each terminal 10, each relay device 30, management system 50, each router 70, program providing system 90, and maintenance system 100 correspond to those in general IPv4. The IP address is simply shown. For example, the IP address of the terminal 10aa is "1.2.1.3". Although IPv6 may be used instead of IPv4, IPv4 is used to simplify the description.

  Each terminal 10 is not only a call between a plurality of business establishments or a call between different rooms within the same business establishment, but also a call within the same room or a conversation between outdoor and indoor or outdoor and outdoor. It may be used. When each terminal 10 is used outdoors, wireless communication such as a cellular phone communication network is performed.

  Each terminal 10 shown in FIG. 1 is a terminal for realizing a user's call by transmitting and receiving call data, and is, for example, a video conference terminal. Furthermore, the terminal 10 transmits and receives call data using a predetermined communication method (a call control method for connecting or disconnecting a call destination and an IP packetizing call data). Do.

  Note that as this call control method, (1) SIP (Session Initiation Protocol), (2) H.323, (3) protocol extended SIP, (4) instant messenger protocol, (5) SIP MESSAGE method (6) Internet relay chat protocol (IRC (Internet Relay Chat)), (7) a protocol which is an extension of the instant messenger protocol, and the like. Among them, (4) the protocol of instant messenger is, for example, (4-1) Extensible Messaging and Presence Protocol (XMPP), or (4-2) ICQ (registered trademark), AIM (registered trademark), or Skype (registered trademark) It is a protocol used by (trademark) etc. Also, (7) a protocol that is an extension of the instant messenger protocol is, for example, Jingle.

  Also, among the plurality of terminals 10, for example, a communication method in which the call control method is an instant messenger protocol (or a protocol obtained by extending the instant messenger protocol) and the encoding method is SVC (Scalable Video Coding) is used Terminal 10 is represented as a "dedicated terminal". Further, among the plurality of terminals 10, the terminal 10 using a communication method different from the dedicated terminal in the call control method and the coding method is represented as a "non-dedicated terminal". Furthermore, in the present embodiment, the “dedicated terminal” is described as a terminal manufactured, sold, or managed by a specific company as an example of two terminals having different communication methods, and the “non-dedicated terminal” is the above specified It is described as a terminal manufactured, sold or managed outside the company of In this embodiment, the terminals manufactured, sold, or managed by different companies in this way often have different communication methods, and thus will be described using an example as described above. As an example of two terminals having different communication methods, among terminals manufactured or sold by the same company, a terminal with a new manufacturing time or sales time is taken as a "dedicated terminal", and a terminal with an old manufacturing time or sales time is It may be a non-dedicated terminal. Further, a dual codec-compatible terminal having a dedicated terminal function and a non-dedicated terminal function performs communication in the same coding system as that of the opposite terminal by activating either the dedicated terminal function or the non-dedicated terminal function. That is, by activating the dedicated terminal function, communication can be performed in the same encoding scheme as the dedicated terminal. By activating the non-dedicated terminal function, it is possible to communicate with the non-dedicated terminal in the same coding scheme.

  Each relay device 30 is a computer system that relays call data between a plurality of terminals 10. The management system 50 is a computer system that centrally manages login authentication from the terminal 10, management of the operation state of the terminal 10 and call status, management of a destination list, etc., and communication status of the relay device 30 and the like. The image of the image data may be a moving image or a still image, or may be both a moving image and a still image.

  The program providing system 90 is a computer system that provides the terminal 10, the relay device 30, the management system 50, and the maintenance system 100 with the programs used by each via the communication network 2.

  The maintenance system 100 is a computer system for performing maintenance, management, or maintenance of at least one of the terminal 10, the relay apparatus 30, the management system 50, and the program providing system 90. For example, when the maintenance system 100 is installed in the country, and the terminal 10, the relay device 30, the management system 50, or the program providing system 90 is installed outside the country, the maintenance system 100 can remotely communicate via the communication network 2. And maintenance such as maintenance, management, and maintenance of at least one of the terminal 10, the relay device 30, the management system 50, and the program providing system 90. Further, the maintenance system 100 does not go through the communication network 2, but at least one of the terminal 10, the relay device 30, the management system 50, and the program providing system 90, a model number, a serial number, a sales destination, maintenance inspection, Or perform maintenance such as management of failure history.

  Subsequently, a first communication pattern for realizing a call between two terminals 10 will be described with reference to FIGS. 2 and 3. In addition, FIG. 2 is a conceptual diagram which shows the communication condition in the case of implement | achieving a telephone call between the communication terminals which have an exclusive terminal function. The terminal 10 may be a dual codec compatible terminal having a dedicated terminal, a non-dedicated terminal, and a dedicated terminal function (an example of a first call function) and a non-dedicated terminal function (an example of a second call function). include. Here, the non-dedicated terminal indicates a terminal different from the dedicated terminal in the call control scheme and the coding scheme as described above. Furthermore, the non-dedicated terminal function indicates a terminal function having the same call control method as the dedicated terminal function and a different encoding method.

  Among these, the dedicated terminal and the terminal for which the dedicated terminal function has been activated are exclusively used in the call system 1 which executes the first communication pattern, as shown in FIG. FIG. 2 shows the case where the request source terminal is a dual codec compatible terminal 10, the dedicated terminal function is activated, and the destination terminal is a dedicated terminal.

  For example, the call system 1 uses a communication method in which the call control method is an instant messenger protocol (or a protocol obtained by extending the instant messenger protocol) and the encoding method is H.264 / SVC (Scalable Video Coding). And communicate call data. Specifically, as shown in FIG. 2, in the call system 1, between the request source terminal and the destination terminal, management for transmitting and receiving various management information via the management system 50. A communication session sei is established. The communication session sei is also a communication session for call control.

  On the other hand, between the request source terminal in which the dedicated terminal function is activated and the relay apparatus 30, 4 of the high resolution image data, the medium resolution image data, the low resolution image data, and the voice data according to the SVC coding method. A first communication session sed1 for a call to send and receive one call data has been established. Furthermore, between the relay device 30 and the destination terminal, similarly, four speech data of high resolution image data, medium resolution image data, low resolution image data, and voice data are transmitted and received according to the SVC encoding method. A second communication session sed2 for the call has been established.

  Here, the resolution of the image of the image data handled in the first communication pattern shown in FIG. 2 will be described with reference to FIG. FIG. 3 is a conceptual diagram showing the image quality of image data transmitted and received according to the SVC standard in FIG.

  As shown in FIG. 3A, the low resolution image, which is 160 pixels wide and 120 pixels high and is a base image, and as shown in FIG. 3B, is horizontal As shown in FIG. 3C, data of a high resolution image consisting of 640 pixels in the horizontal direction and 480 pixels in the vertical direction is transmitted and received as shown in FIG. 3C. Among these, when passing through a narrow band path, low-quality image data consisting only of low-resolution image data to be a base image is relayed by the relay device 30. If the bandwidth is relatively wide, the relay device 30 relays medium-quality image data consisting of low-resolution image data to be a base image and medium-resolution image data. Also, when the bandwidth is very wide, the relay device 30 relays high-quality image data consisting of low-resolution image data serving as a base image, medium-resolution image data, and high-resolution image data. .

  Subsequently, a second communication pattern for realizing a call between two terminals 10 will be described with reference to FIGS. 4 and 5. In addition, it is the conceptual diagram which showed the communication condition in the case of implement | achieving a telephone call between the call terminals which have a non-dedicated terminal function.

  The non-dedicated terminal and the terminal for which the non-dedicated terminal function has been activated are exclusively used in the call system 1 'executing the second communication pattern, as shown in FIG. As described above, in the call system 1 that executes the first communication pattern, the dedicated terminal and the dedicated terminal function can not be used because the communication methods are different. Note that FIG. 4 shows the case where the request source terminal is a dual codec compatible terminal, the non-dedicated terminal function is being activated, and the destination terminal is a non-dedicated terminal.

  In this call system 1 ', the call control method of the request source terminal is the same instant messenger protocol as the first communication pattern (or a protocol obtained by extending the instant messenger protocol), and the coding method is the first communication pattern Unlike the above, the communication data is communicated using a communication method which is H.264 / AVC (Advanced Video Coding). Specifically, as shown in FIG. 4, in the call system 1 ′, a management communication session sei 1 for transmitting and receiving various management information is established between the request source terminal and the management system 50. It is done. The communication session sei1 is also a communication session for call control. Furthermore, when the non-dedicated terminal function is activated in the request source terminal, the encoding scheme is changed from SVC to AVC.

  On the other hand, a communication session sei2 for call control of a non-dedicated terminal is established between the management system 50 and the destination terminal, and this call control method is different from that of the request source terminal. For example, it is SIP (Session Initiation Protocol) or H.323. In this case, since the call control method differs between the request source terminal and the destination terminal, the management system 50 converts the call control method. Specifically, when the request source terminal is activating the non-dedicated terminal function, the data related to call control is converted based on the conversion rule data used for the management system 50 to convert the call control method. And implement call control. Furthermore, the coding scheme of the destination terminal (non-dedicated terminal) is the same AVC as the request source terminal whose non-dedicated terminal function is active.

  A communication session sed for a call for transmitting and receiving call data is established between the request source terminal and the destination terminal. The communication session sed may be established directly between the request source terminal and the destination terminal or may be established via the relay device.

  Here, the resolution of the image of the image data handled by the second communication pattern shown in FIG. 4 will be described with reference to FIG. FIG. 5 is a conceptual diagram showing the image quality of image data transmitted and received according to the AVC standard in FIG. As shown in FIG. 5, only one data of an image consisting of 320 pixels in the horizontal direction and 240 pixels in the vertical direction is transmitted / received.

<< Hardware Configuration of Embodiment >>
Next, the hardware configuration of the present embodiment will be described. FIG. 6 is an external view of the call terminal according to the present embodiment. As shown in FIG. 6, the terminal 10 includes a housing 1100, an arm 1200, and a camera housing 1300. Among them, the front wall surface 1110 of the housing 1100 is provided with a suction surface (not shown) formed by a plurality of suction holes, and the rear wall surface 1120 of the housing 1100 is formed with a plurality of exhaust holes. An exhaust surface 1121 is provided. As a result, by driving the cooling fan incorporated in the housing 1100, the outside air at the rear of the terminal 10 can be taken in via the air intake surface (not shown) and exhausted to the rear of the terminal 10 via the exhaust surface 1121. A sound collection hole 1131 is formed on the right side wall surface 1130 of the housing 1100, and a sound such as voice, object sound, and noise can be collected by a built-in microphone 114 described later.

  An operation panel 1150 is formed on the right wall surface 1130 side of the housing 1100. The operation panel 1150 is provided with a plurality of operation buttons (108a to 108e) which will be described later, a power switch 109 which will be described later, and an alarm lamp 119 which will be described later. A sound output surface 1151 formed by a plurality of sound output holes for passing therethrough is formed. Further, on the side of the left side wall surface 1140 of the housing 1100, a housing portion 1160 as a concave portion for housing the arm 1200 and the camera housing 1300 is formed. The right wall surface 1130 of the housing 1100 is provided with a plurality of connection ports (1132 a to 1132 c) for electrically connecting a cable to an external device connection I / F 118 described later. On the other hand, the left wall surface 1140 of the housing 1100 is provided with a connection port (not shown) for electrically connecting a cable 120 c for the display 120 to an external device connection I / F 118 described later.

  In the following, the "operation button 108" is used to indicate any of the operation buttons (108a to 108e), and "if any connection port of the connection ports (1132a to 1132c) is indicated. Description will be made using the connection port 1132 ".

  Next, the arm 1200 is attached to the housing 1100 via the torque hinge 1210, and the arm 1200 is configured to be vertically rotatable with respect to the housing 1100 within the range of the tilt angle θ1 of 135 degrees. ing. FIG. 6 shows a state in which the tilt angle θ1 is 90 degrees. The camera housing 1300 is provided with a built-in camera 112 described later, and can image a user, a document, a room, and the like. Further, a torque hinge 1310 is formed in the camera housing 1300. The camera housing 1300 is attached to the arm 1200 via a torque hinge 1310. The camera housing 1300 is attached to the arm 1200 via the torque hinge 1310, and the camera housing 1300 is at a pan angle θ2 of ± 180 degrees with the state shown in FIG. In the range of ± 45 degrees, and in the range of the tilt angle θ3, it is configured to be rotatable in the vertical and horizontal directions.

  Since the relay device 30, the management system 50, the program providing system 90, and the maintenance system 100 are the same as the appearance of a general server computer, the description of the appearance will be omitted.

  FIG. 7 is a hardware configuration diagram of a terminal according to the present embodiment. As illustrated in FIG. 7, the terminal 10 according to the present embodiment includes a program used to drive the CPU 101 such as a central processing unit (CPU) 101 that controls the entire operation of the terminal 10 and an initial program loader (IPL). A stored ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103 used as a work area for the CPU 101, a program for the terminal 10, a flash memory 104 for storing various data such as image data and audio data, the CPU 101 The solid state drive (SSD) 105 controls reading and writing of various data to the flash memory 104 according to the control of the media drive 107, and the media drive 107 controls data reading or writing (storage) to the recording medium 106 such as the flash memory. When selecting the destination of The operation button 108, the power switch 109 for switching on / off the power of the terminal 10, and a network I / F (Interface) 111 for data transmission using the communication network 2 are provided.

  The terminal 10 also has a built-in camera 112 that captures an object and obtains image data according to control of the CPU 101, an imaging device I / F 113 that controls driving of the camera 112, a built-in microphone 114 that inputs sound, and sound A built-in speaker 115 for outputting the sound, an audio input / output I / F 116 for processing an input / output of an audio signal between the microphone 114 and the speaker 115 under the control of the CPU 101, and an external display 120 As shown in FIG. 5, the display I / F 117 for transmission, the external device connection I / F 118 for connecting various external devices, the alarm lamp 119 for notifying abnormality of various functions of the terminal 10, and the above respective components are shown. Bus lines 110 such as an address bus and a data bus for electrically connecting To have.

  The display 120 is a display unit configured of a liquid crystal or an organic EL that displays an image of an object, an operation, and the like. The display 120 is also connected to the display I / F 117 by a cable 120c. The cable 120c may be a cable for an analog RGB (VGA) signal or a cable for a component video, or a cable for HDMI (High-Definition Multimedia Interface) or DVI (Digital Video Interactive) signals. It may be a cable of HDMI is a registered trademark.

  The camera 112 includes a lens and a solid-state imaging device that converts light into electric charge to digitize an image (image) of a subject, and as a solid-state imaging device, a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD) Etc. are used.

  An external camera, an external microphone, an external speaker, etc. are connected to the external device connection I / F 118 by a USB (Universal Serial Bus) cable or the like inserted into the connection port 1132 of the housing 1100 shown in FIG. The external devices of are connectable electrically. When an external camera is connected, the external camera is driven prior to the built-in camera 112 according to the control of the CPU 101. Similarly, when an external microphone is connected or an external speaker is connected, the external microphone or the external speaker 115 is given priority over the built-in microphone 114 or the built-in speaker 115 according to the control of the CPU 101. External speakers drive.

  The recording medium 106 is configured to be removable from the terminal 10. Further, as long as the nonvolatile memory performs reading or writing of data according to the control of the CPU 101, not only the flash memory 104 but also EEPROM (Electrically Erasable and Programmable ROM) or the like may be used.

  FIG. 8 is a hardware configuration diagram of a management system according to the present embodiment of the present invention. The management system 50 includes a CPU 201 that controls the overall operation of the management system 50, a ROM 202 that stores programs used to drive the CPU 201, such as IPL, a RAM 203 that is used as a work area of the CPU 201, and various programs for the management system 50. HD 204 for storing data, HDD (Hard Disk Drive) 205 for controlling reading and writing of various data to HD 204 according to control of CPU 201, and media for controlling reading and writing (storage) of data to recording media 206 such as flash memory. A drive 207, a display 208 for displaying various information such as a cursor, a menu, a window, characters, or an image, a network I / F 209 for performing data communication using the communication network 2, characters A keyboard 211 having a plurality of keys for inputting numerical values and various instructions, a mouse 212 for selecting and executing various instructions, selecting an object to be processed, moving a cursor, etc. CD as an example of a removable recording medium -CD-ROM drive 214 that controls reading and writing of various data to ROM (Compact Disc Read Only Memory) 213, and an address for electrically connecting the above-described respective components as shown in FIG. A bus line 210 such as a bus or a data bus is provided.

  On the other hand, since the relay apparatus 30, the program providing system 90, and the maintenance system 100 have the same hardware configuration as the management system 50, the description will be omitted. However, various data such as programs for controlling the relay device 30, the program providing system 90, and the maintenance system 100 are stored in each HD 204.

  Note that each program for the terminal 10, the relay device 30, the program providing system 90, and the maintenance system 100 is a computer readable recording medium (such as the recording medium 106) by a file of an installable format or an executable format. May be recorded and distributed. Further, as another example of the above recording medium, a CD (Compact Disc Recordable), a DVD (Digital Versatile Disk), a Blu-ray Disc, etc. may be mentioned.

<< Functional Configuration of Embodiment >>
Next, the functional configuration of the present embodiment will be described. FIG. 9 is a functional block diagram of the terminal 10, the relay device 30, and the management system 50 which constitute a part of the call system 1 of the present embodiment. In FIG. 9, the terminal 10, the relay device 30, and the management system 50 are connected so as to be able to perform data communication via the communication network 2.

<Functional configuration of terminal>
The terminal 10 includes a transmission / reception unit 11, an operation input reception unit 12, a login request unit 13, an imaging unit 14, an audio input unit 15a, an audio output unit 15b, a display control unit 16, an activation unit 17, a destination list creation unit 18, and storage The read processing unit 19 is included. These functions are realized by any one of the components shown in FIG. 7 being operated by an instruction from the CPU 101 according to a program for the terminal 10 expanded on the RAM 103 from the flash memory 104. Or means.

  The terminal 10 further includes a storage unit 1000 configured by the RAM 103 illustrated in FIG. 7 and the flash memory 104 illustrated in FIG. 7. In the storage unit 1000, a visual information management DB (Data Base) 1001 configured by a visual information management table described later is constructed. Furthermore, the storage unit 1000 stores a dedicated terminal application for realizing the dedicated terminal function in the terminal 10 and a non-dedicated terminal application for realizing the non-dedicated terminal function in the terminal 10.

(Visual information management table)
FIG. 10 is a conceptual diagram showing a visual information management table. In the visual information management table, visual information represented by a destination list displayed on the display 120 is managed in association with each piece of operation state information indicating the operation state of the destination terminal. Each visual information is, for example, each icon in the form as shown in FIG. Each visual information constituting the visual information management table may be sent from the management system 50 when the request source terminal makes a login request in step S22 described later, or the storage unit 1000 before shipment of the request source terminal from the factory. May be stored.

  Note that the visual information of the present embodiment includes the first visual information visually indicating that the communication method used by the destination terminal is the communication method used by the request source terminal (dedicated terminal), and It visually indicates that the communication method used is not the communication method used by the request source terminal (dedicated terminal), and is classified into second visual information visually different from the first visual information. Among them, the first visual information includes visual information such as icons indicating the operating state: online (callable), online (during call), online (temporary suspension), or offline.

  In the case where the second visual information is communicated between the terminals 10 each having two functions, a dedicated terminal function and a non-dedicated terminal function, the request source terminal activates the dedicated terminal function, and the destination terminal Shows an icon or the like displayed on the display 120 of the request source terminal when the non-dedicated terminal function is activated.

(Each functional configuration of the terminal)
Next, each functional configuration of the terminal 10 will be described in detail using FIGS. 7 and 9. In the following, in describing each functional configuration of the terminal 10, among the components shown in FIG. 7, the relationship with the main components for realizing each functional configuration of the terminal 10 will also be described. .

  The transmission / reception unit 11 of the terminal 10 shown in FIG. 9 is realized by an instruction from the CPU 101 shown in FIG. 7 and the network I / F 111 shown in FIG. To transmit and receive various data (or information) with the terminal, device or system of The transmitting / receiving unit 11 starts reception of each state information indicating the state of each terminal as a destination candidate from the management system 50 before starting a call with a desired destination terminal. This state information is not only the operating state of each terminal 10 (on-line or off-line state), but whether it is possible to make a call even if it is on-line, whether it is in a call or is away Show the detailed status of This state information is not only the operating state of each terminal 10, but the cable 120c is disconnected from the terminal 10 at the terminal 10, outputs audio but does not output an image or does not output audio. (MUTE) etc. show various states. The state information also includes the state in which the non-dedicated terminal function is being activated as described above. Hereinafter, as an example, a case where the state information indicates the operating state will be described.

  The operation input reception unit 12 is realized by an instruction from the CPU 101 shown in FIG. 7 and the operation button 108 and the power switch 109 shown in FIG. 7, and receives various inputs from the user. For example, when the user turns on the power switch 109 shown in FIG. 7, the operation input receiving unit 12 shown in FIG. 9 receives power on and turns on the power.

  The login request unit 13 is realized by an instruction from the CPU 101 shown in FIG. 7, and requests the management system 50 to log in via the communication network 2 from the transmission / reception unit 11 when receiving the power on. And automatically transmits the current IP address of the request source terminal. In addition, when the user turns the power switch 109 from the ON state to the OFF state, the operation input reception unit 12 completely turns the power OFF after the transmitting / receiving unit 11 transmits the status information to the management system 50 to the effect that the power is turned OFF. Do. As a result, the management system 50 can recognize that the terminal 10 has been powered off after being powered on.

  The imaging unit 14 is realized by an instruction from the CPU 101 shown in FIG. 7 and the camera 112 and the imaging device I / F 113 shown in FIG. Output data.

  The voice input unit 15a is realized by an instruction from the CPU 101 shown in FIG. 7 and a voice input / output I / F 116 shown in FIG. 7, and the user's voice is converted into a voice signal by the microphone 114. Thereafter, voice data relating to this voice signal is input. The audio output unit 15 b is realized by an instruction from the CPU 101 shown in FIG. 7 and the audio input / output I / F 116 shown in FIG. 7 and outputs an audio signal related to audio data to the speaker Output audio from

  The display control unit 16 is realized by an instruction from the CPU 101 shown in FIG. 7 and the display I / F 117 shown in FIG. 7 and combines the received image data with different resolutions, as described later, Control for transmitting the combined image data to the display 120 is performed. In addition, the display control unit 16 can transmit the information on the destination list received from the management system 50 to the display 120 and can cause the display 120 to display the destination list.

  Further, the display control unit 16 extracts corresponding visual information by searching the visual information management table (see FIG. 10) using the operating state information received from the management system 50 by the transmitting / receiving unit 11 as a search key. The display 120 of the terminal 10 is displayed by being included in the destination list.

  The activation unit 17 determines whether the transmission / reception unit 11 receives a call start request from another dedicated terminal (or another terminal whose dedicated terminal function has been activated). The activation unit 17 also activates either the dedicated terminal function or the non-dedicated terminal function. Furthermore, the activation unit 17 stops the dedicated terminal function or the non-dedicated terminal function being activated.

  The destination list creating unit 18 uses icons as statuses of destination candidates as shown in FIG. 20 based on destination list information described later and status information of the terminal 10 as each destination candidate received from the management system 50. Create and update the indicated destination list.

  Storage / read processing unit 19 is implemented by an instruction from CPU 101 shown in FIG. 7 and SSD 105 shown in FIG. 7 or realized by an instruction from CPU 101, and stores various data in storage unit 1000 or stores it. A process of reading various data stored in the unit 1000 is performed. The storage unit 1000 stores a terminal ID (Identification) for identifying the terminal 10, a password, and the like. Furthermore, the storage unit 1000 overwrites and stores the image data and the voice data received when making a call with the destination terminal each time they are received. Among these, the image is displayed on the display 120 by the image data before being overwritten, and the sound is output from the speaker 115 by the audio data before being overwritten.

  The terminal ID of the present embodiment and a relay device ID described later indicate identification information such as a language, characters, symbols, or various marks used to uniquely identify the terminal 10 and the relay device 30, respectively. The terminal ID and the relay device ID may be identification information in which at least two of the language, characters, symbols, and various marks are combined.

<Functional configuration of relay device>
The relay device 30 includes a transmission / reception unit 31 and a data quality change unit 32. These units are functions implemented by any of the components shown in FIG. 8 being operated by an instruction from the CPU 201 according to a program for the relay device 30 developed on the RAM 203 from the HD 204 or It is a means.

(Each functional configuration of relay device)
Next, each functional configuration of the relay device 30 will be described in detail. In the following, in describing each functional configuration of relay device 30, among the components shown in FIG. 8, the relationship with the main components for realizing each functional configuration of relay device 30 is also included. explain.

  The transmission / reception unit 31 of the relay device 30 shown in FIG. 9 is realized by an instruction from the CPU 201 shown in FIG. 8 and the network I / F 209 shown in FIG. It exchanges various data (or information) with other terminals, devices, or systems. Thus, the relay device 30 relays the call data between the plurality of terminals 10.

  Furthermore, the transmitting / receiving unit 31 instructs the start of the communication session (the first communication session sed1) to the destination indicated by the IP address of the request source terminal among the IP addresses received by the transmitting / receiving unit 31. To send session start instruction information. The transmission / reception unit 31 also starts a session for instructing the destination indicated by the IP address among the IP addresses received by the transmission / reception unit 31 to start a communication session (second communication session). The instruction information and the IP address of the destination terminal are transmitted.

  The data quality change unit 32 is realized by an instruction from the CPU 201 shown in FIG. 8 and changes the image quality of the image data sent from the transmission source terminal. As a result, even if a delay occurs in the reception of image data at the terminal 10 due to the mixing of the communication network 2 or the like, the relay device 30 takes measures against the delay by reducing the image quality of the image data to be relayed. It can be carried out. For example, when a delay in reception of image data occurs, the delay is caused by interrupting the relay of high resolution image data (see FIG. 3C) among the image data of three image qualities shown in FIG. Take measures for

<Functional configuration of management system>
The management system 50 includes a transmission / reception unit 51, a terminal authentication unit 52, a state management unit 53, an extraction unit 54, a determination unit 55, a session management unit 56, a conversion unit 57, and a storage / read processing unit 59. These units are functions implemented by any one of the components shown in FIG. 8 being operated by an instruction from the CPU 201 according to a program for the management system 50 developed on the RAM 203 from the HD 204 or It is a means. The management system 50 also includes a storage unit 5000 constructed by the HD 204 shown in FIG. The storage unit 5000 stores frame data of a destination list, which will be described later, and conversion rule data used to convert a call control method.

(Relay device management table)
FIG. 11 is a conceptual diagram showing the relay device management table. In the storage unit 5000, a relay device management DB 5001 configured by the relay device management table as shown in FIG. 11 is constructed. In this relay device management table, for each relay device ID of each relay device 30, the operation state of each relay device 30 and the reception date and time when the state information indicating the operation state is received by the management system 50, IP address of the relay device 30 And the maximum data call rate (Mbps) in the relay device 30 are managed in association with each other. For example, in the relay device management table shown in FIG. 11, the relay device 30a having the relay device ID "111a" has an operation status of "online" and the date and time when the status information was received by the management system 50 is "2011". At 13:00 on November 10, the IP address of this relay device 30a is "1.2.1.2", and it is indicated that the maximum data communication speed in this relay device 30a is 100 Mbps. There is.

(Terminal authentication management table)
FIG. 12 is a conceptual diagram showing a terminal authentication management table. In the storage unit 5000, a terminal authentication management DB 5002 configured by a terminal authentication management table as shown in FIG. 12 is constructed. In this terminal authentication management table, an authentication password is associated with each terminal ID of all the terminals 10 managed by the management system 50 and managed. For example, in the terminal authentication management table shown in FIG. 12, it is indicated that the terminal ID of the terminal 10aa is "01aa" and the password is "aaaa".

(Terminal status management table)
FIG. 13 is a conceptual diagram showing a terminal state management table. In the storage unit 5000, a terminal state management DB 5003 configured of a terminal state management table as shown in FIG. 13 is constructed. In this terminal state management table, for each terminal ID of each terminal 10, the destination name when each terminal 10 is the destination, the operating state of each terminal 10, and the reception date and time when login request information described later is received by the management system 50 , And the IP address of the terminal 10 are associated and managed. For example, in the terminal state management table shown in FIG. 13, the terminal 10aa having the terminal ID "01aa" has the terminal name "Japan Tokyo Business Office AA terminal" and the operating state is "on-line (callable)" The date when the login request information was received by the management system 50 is "13:40 on November 10, 2011", and the IP address of this terminal 10aa is "1.2.1.3". It is done.

  However, the terminal status management table manages terminal information including the terminal ID, terminal name, operation status, reception date, and IP address of the non-dedicated terminal 10 (that is, a terminal having a dedicated terminal function and a terminal other than the dedicated terminal). It is not managed because it is out of scope.

(Destination list management table)
FIG. 14 is a conceptual diagram showing a destination list management table. In the storage unit 5000, a destination list management DB 5004 configured by a destination list management table as shown in FIG. 14 is constructed. In the destination list management table, all terminal IDs of destination terminals registered as candidates of destination terminals are managed in association with the terminal ID of a request source terminal that requests start of a call. For example, in the destination list management table shown in FIG. 14, the candidate of the destination terminal which can request the start of a call from the request source terminal (terminal 10 aa) whose terminal ID is “01 aa” has the terminal ID “ It is shown that the terminal 10ab of “01ab”, the terminal 10ba of which the terminal ID is “01ba”, and the terminal 10bb of which the terminal ID is “01bb”. The candidate of the destination terminal is updated by being added or deleted by a request for addition or deletion from any request source terminal to the management system 50. As in the terminal state management table, in the destination list management table (see FIG. 14), the terminal IDs of non-dedicated terminals are not managed because they are not managed.

(Session management table)
FIG. 15 is a conceptual diagram showing a session management table. In the storage unit 5000, a session management DB 5005 configured of a session management table as shown in FIG. 15 is constructed. In this session management table, the relay apparatus ID of the relay apparatus 30 used for relaying the call data (image data and voice data), the terminal ID of the request source terminal, the terminal ID of the destination terminal, and the image data in the destination terminal are received The reception delay time (ms) at the time of communication and the delay time information indicating this delay time are sent from the destination terminal and the reception date and time received by the management system 50 are managed in association with one another.

  For example, in the session management table shown in FIG. 15, the relay device 30a (relay device ID "111a") has a requester terminal (terminal 10aa) whose terminal ID is "01aa" and a terminal ID "01ca". Image data and voice data are relayed with the destination terminal (terminal 10 ca), and the delay time of the image data at "14:00 on November 10, 2011" at the destination terminal (terminal 10 ca) It is shown to be 200 (ms). When a call is made between two terminals 10, the reception date and time of the delay time information may be managed based on the delay time information transmitted from the request source terminal instead of the destination terminal. However, when making a call between three or more terminals 10, the reception date and time of the delay time information is managed based on the delay time information transmitted from the terminal 10 on the image data and audio data receiving side. .

(Each functional configuration of management system)
Next, each functional configuration of the management system 50 will be described in detail. In the following, in describing each functional configuration of the management system 50, among the components shown in FIG. 8, the relationship with the main components for realizing each functional configuration of the management system 50 is also included. explain.

  The transmission / reception unit 51 is executed by an instruction from the CPU 201 shown in FIG. 8 and the network I / F 209 shown in FIG. 8, and transmits various terminals (devices or systems) and various data via the communication network 2 Or send and receive information).

  The terminal authentication unit 52 is realized by an instruction from the CPU 201 shown in FIG. 8, and uses the terminal ID and password included in the login request information received via the transmission / reception unit 51 as a search key, and performs terminal authentication management. Terminal authentication is performed by searching a table (see FIG. 12) and determining whether the same terminal ID and password are managed in this terminal authentication management table.

  The state management unit 53 is realized by an instruction from the CPU 201 shown in FIG. 8, and the terminal state management table (see FIG. 13) is used to manage the operation state of the request source terminal that has made the login request. The terminal ID of the terminal, the operation state of the request source terminal, the date and time when the login request information was received by the management system 50, and the IP address of the request source terminal are associated and stored and managed. In addition, the state management unit 53 determines the terminal state based on the state information indicating that the power is turned off, which has been sent from the terminal 10 by the user turning the state of the power switch 109 of the terminal 10 off. The operation state indicating online of the management table (see FIG. 13) is changed to offline.

  The extraction unit 54 is realized by an instruction from the CPU 201 shown in FIG. 8 and searches each management DB constructed in the storage unit 5000 with various search keys, and data (information) corresponding to the search key is obtained. Extract as search results.

  For example, the extraction unit 54 searches the destination list management table (see FIG. 14) using the terminal ID of the request source terminal that made the login request as a key, and the terminal IDs of candidate destination terminals that can talk with the request source terminal Extract. The extraction unit 54 searches the terminal state table (see FIG. 13) using the terminal ID of the destination terminal candidate as a search key, and extracts the operating state for each terminal ID. As a result, the extraction unit 54 can acquire the operating state of the candidate of the destination terminal that can make a call with the request source terminal that has made the login request.

  Furthermore, the extraction unit 54 searches the destination list management table (see FIG. 14) using the terminal ID of the request source terminal that has made the login request as a key, and registers the terminal ID of the request source terminal as a destination terminal candidate. The terminal IDs of other request source terminals are also extracted. The extraction unit 54 also searches the terminal state management table (see FIG. 13) using the terminal ID as a search key, and acquires the operation state of the request source terminal that has made the login request.

  Furthermore, the extraction unit 54 extracts the IP address of the corresponding terminal 10 by searching the terminal state management table (see FIG. 13) using the terminal ID of the terminal 10 received by the transmission / reception unit 51 as a search key. The extraction unit 54 also extracts the corresponding terminal ID by searching the terminal state management table (see FIG. 13) using the IP address of the destination terminal as a search key.

  Subsequently, the determination unit 55 is realized by an instruction from the CPU 201 shown in FIG. 8 and determines whether the operating state indicated by the operating state information is “online”. Furthermore, if the determining unit 55 determines that the operating status information can be transmitted to the predetermined terminal 10 when it determines that it is "online", and determines that it is not "online", it determines that it is not. It is determined that the operation status information can not be sent to 10.

  The session management unit 56 is realized by an instruction from the CPU 201 shown in FIG. 8, and in the session management table (see FIG. 15) of the storage unit 5000, the relay device ID of the relay device 30 used for relaying call data. The destination terminal transmits the terminal ID of the request source terminal, the terminal ID of the destination terminal, the delay time (ms) of reception when the image data is received at the destination terminal, and the delay time information indicating this delay time from the destination terminal And the received date and time received by the management system 50 are associated and stored and managed. Further, the session management unit 56 creates a session ID used to establish a communication session.

  When the operation status corresponding to the terminal ID of the request source terminal indicates that the non-dedicated terminal function has been activated in the terminal status management table, conversion unit 57 calls according to the conversion rule data stored in storage unit 5000 in advance. Control is executed to mutually convert the call control method transmitted from the request source terminal and the call control method transmitted from the destination terminal.

  Storage / read processing unit 59 is executed by an instruction from CPU 201 shown in FIG. 8 and HDD 205 shown in FIG. 8 to store various data in storage unit 5000 or stored in storage unit 5000. Perform processing to read out various data.

<< Process or Operation of Embodiment >>
Subsequently, the case where the terminal 10 having the dedicated terminal function and the non-dedicated terminal function is the request source terminal will be described with reference to FIGS. 6, 9, and 16 to 20. FIG. 16 is a sequence diagram showing a call start request.

  As shown in FIG. 16, first, when the user of the dual codec compatible request source terminal (terminal 10aa) turns on the power switch 109 shown in FIG. 6, it is shown in FIG. The operation input receiving unit 12 receives power on and turns on the power (step S21). Then, the log-in request unit 13 automatically transmits log-in request information indicating a log-in request to the management system 50 from the transmission / reception unit 11 via the communication network 2 when receiving the power on (step S22). The login request information includes a terminal ID for identifying the terminal 10aa which is the request source terminal, and a password. The terminal ID and the password are data read from the storage unit 1000 via the storage / read processing unit 19 and sent to the transmission / reception unit 11. When login request information is transmitted from the request source terminal (terminal 10aa) to the management system 50, the management system 50 on the receiving side can grasp the IP address of the terminal 10aa on the transmitting side.

  Next, the terminal authentication unit 52 of the management system 50 searches the terminal authentication management table (see FIG. 12) using the terminal ID and the password included in the login request information received via the transmission / reception unit 51 as a search key. The terminal authentication is performed by determining whether the same terminal ID and the same password are managed in the terminal authentication management table (step S23). Since the same terminal ID and the same password are managed by the terminal authentication unit 52, the state management unit 53 determines that it is a login request from the terminal 10 having a valid usage right, In the terminal state management table (see FIG. 13), for each record indicated by the terminal ID and destination name of the terminal 10aa, the operation state, the date and time when the above login request information was received, and the IP address of the terminal 10aa are associated and stored (Step S24). As a result, in the terminal state management table, the operating state "online", the reception date and time "2011.11.10.13:40" and the terminal IP address "1.2.1. "3" will be managed in association.

  Then, the transmission / reception unit 51 of the management system 50 requests authentication result information indicating the authentication result obtained by the terminal authentication unit 52 via the communication network 2 as the request source terminal (terminal 10 aa). (Step S25). In the present embodiment, a case where it is determined by the terminal authentication unit 52 that the terminal has a valid usage right will be described continuously below.

  The extraction unit 54 of the management system 50 searches the destination list management table (see FIG. 14) based on the terminal ID “01aa” of the request source terminal (terminal 10 aa) that has made the log-in request to obtain the request source terminal (terminal The terminal ID of the other request source terminal which has registered the terminal ID "01aa" of 10aa) as the destination terminal candidate is extracted (step S26). Here, in order to simplify the description, the case where the terminal ID extracted in step S26 is the terminal ID "01ba" of the terminal 10ba will be continuously described below.

  Next, the extraction unit 54 of the management system 50 searches the terminal state management table (see FIG. 13) using the terminal ID "01aa" of the request source terminal (terminal 10aa) that has made the login request as a search key, The operation state of the request source terminal (terminal 10aa) that has made the login request is extracted (step S27).

  Next, the transmitting / receiving unit 51 includes, for the terminal 10 ba, the terminal ID “01aa” of the request source terminal (terminal 10 aa) and the operation status information indicating the operation status of the request source terminal (terminal 10 aa) The "terminal state information" is transmitted (step S28). Thereby, the transmitting and receiving unit of the terminal 10 ca receives the state information of the terminal. Therefore, in the terminal 10ba, as in the process of step S28 described later, a destination list in which the latest operating state of the terminal 10aa is reflected is created and displayed on the display 120ba.

  On the other hand, in the request source terminal (terminal 10aa), selection processing of either one of the dedicated terminal function and the non-dedicated terminal function is performed (step S29). Here, the process of selecting a function will be described in more detail with reference to FIG. FIG. 17 is a flowchart showing a process of selecting a dedicated terminal function or a non-dedicated terminal function.

  First, as illustrated in FIG. 18, the display control unit 16 of the request source terminal (terminal 10aa) causes the display 120aa to display the function selection screen 900 (step S29-1). FIG. 18 is a conceptual diagram showing the call function selection screen. As shown in FIG. 18, in the function selection screen 900, a function selection icon 910 (an example of a first icon) for activating a dedicated terminal function and a function selection for activating a non-dedicated terminal function The icon 920 (an example of the second icon) is displayed in parallel. Further, at the lower right side of the function selection screen 900, an end icon 990 for ending the process of function selection is displayed.

  Next, operation input acceptance unit 12 of the request source terminal (terminal 10 aa) determines whether the user has selected function selection icon 910 or function selection icon 920 shown in FIG. 18 (step S29-2). If it is determined in step S29-2 that no icon has been selected, the transmission / reception unit 11 further transmits a signal from another dedicated terminal (or another terminal for which the dedicated terminal function has been activated), It is determined whether a call start request has been accepted (step S29-3). When it is determined that the call start request has not been received (NO), the process returns to the process of step S29-1. On the other hand, if it is determined in step S29-3 that the call start request has been received (YES), the activation unit 17 activates the dedicated terminal function (step S29-4). Thereby, the terminal 10aa can start a call as a dedicated terminal.

  When it is determined in step S29-2 that either the function selection icon 910 or the function selection icon 920 is selected, the function for activating the dedicated terminal function by the operation input accepting unit 12 is further provided. It is determined whether the selection icon 910 has been selected (step S29-5). If it is determined in step S29-5 that the function selection icon 910 has been selected, the activation unit 17 activates the dedicated terminal function (step S29-6). In this case, through steps S41 to S49 described later, the terminal 10aa can start a call as a dedicated terminal.

  On the other hand, when it is determined in step S29-5 that the function selection icon 910 has not been selected (the function selection icon 920 has been selected), the transmission / reception unit 11 of the request source terminal (terminal 10aa) manages Terminal state information indicating that the non-dedicated terminal function is being activated is transmitted to the system 50 (step S29-7). By this transmission, the management system 50 updates the operation state of the terminal ID corresponding to the terminal 10aa in the terminal state management table to a state indicating that the non-dedicated terminal function is being activated. Also, the activation unit 17 of the request source terminal (terminal 10aa) activates the non-dedicated terminal function (step S29-8). However, when the request source terminal (terminal 10 aa) operates as a non-dedicated terminal, the destination list as shown in FIG. 20 is not displayed as described in FIG. It is necessary to input address information (eg, IP address etc.) that can identify the place of. Therefore, when the user inputs, for example, the IP address of the destination terminal (non-dedicated terminal), the operation input reception unit 12 receives specification of the destination (step S29-9). Thereby, the request source terminal (terminal 10aa) can start a call as a non-dedicated terminal.

  More specifically, the request source terminal transmits a call start request addressed to the input IP address to the management system 50, and the management system 50 causes the operation status of the terminal ID of the request source terminal in the terminal status management table to be Since it indicates that the non-dedicated terminal function is activated, the conversion unit 57 converts the received call start request into data according to the conversion data rule (that is, according to the call control method of the non-dedicated terminal). . The converted call start request is transmitted to the destination terminal (non-dedicated terminal) based on the IP address received from the management system 50. The destination terminal (non-dedicated terminal) that has received the call start request responds to the management system 50 if a call is possible, and the management system 50 converts it in accordance with the conversion data rule in the same manner as the call start request. Forward the response to the request source terminal. By this series of call control processing, as shown in FIG. 4, a communication session sed can be established between the request source terminal and the destination terminal. In the case of FIG. 4, since the request source terminal is activating the non-dedicated terminal function, the encoding method uses the same AVC encoding method as the destination terminal (non-dedicated terminal).

  In step S29-9, the IP address is input to the user, but location information such as the IP address of the non-dedicated terminal is stored in advance in the terminal 10 so that the user can select from among them. May be

  Subsequently, after the process of step S29-6 shown in FIG. 17, the process until the call is started will be described using FIG. 19 and FIG. FIG. 19 is a flowchart showing a process of displaying the destination list. FIG. 20 is a conceptual diagram showing a destination list.

  First, at the request source terminal (terminal 10 aa), when receiving the authentication result information indicating the result determined in step S 25 that the terminal is determined to be a terminal having a valid usage right, the transmission / reception unit 11 transmits the communication network 2 The destination list request information indicating that the destination list is requested is transmitted to the management system 50 (step S41). Thereby, the transmitting and receiving unit 51 of the management system 50 receives the destination list request information.

  Next, the extraction unit 54 of the management system 50 searches the destination list management table (see FIG. 14) using the terminal ID "01aa" of the request source terminal (terminal 10aa) that has made the login request as a search key, and the request source terminal The terminal ID of a candidate of a destination terminal capable of communicating with the terminal 10aa) is extracted, and the terminal state management table (see FIG. 13) is searched using this terminal ID as a search key to extract corresponding destination name information (Step S42). Here, in order to simplify the description, the case where the terminal IDs of the terminal 10ab as the dedicated terminal A, the terminal 10ba, the terminal 10ca, the terminal 10cb, etc. are extracted as the terminal 10 of the destination terminal candidate will be continuously described below. Do.

  Next, the extraction unit 54 reads the data of the destination list frame from the storage unit 5000 (step S43). Then, the transmission / reception unit 51 sends “destination list information (destination list frame, terminal ID, destination name)” including the destination list frame and the terminal ID and the destination name information extracted at step S42 to the request source terminal (terminal 10aa) (step S44). Thereby, in the request source terminal (terminal 10aa), the transmission / reception unit 11 receives the destination list information.

  Next, the storage / readout processing unit 19 of the request source terminal (terminal 10 aa) stores destination list information in the storage unit 1000 (step S 45).

  As described above, in the present embodiment, the management system 50 centrally manages the destination list information of all the terminals instead of managing the destination list information in each terminal 10. Therefore, the new terminal 10 is used in the call system 1, the terminal 10 of the new model is included instead of the already used terminal 10, and the appearance of the destination list frame is changed. Even if it happens, the management system 50 side deals with it collectively, so it is possible to save the trouble of changing the destination list information on each terminal 10 side.

  Further, on the management system 50 side, the extraction unit 54 extracts the operating state of the terminal 10 as a destination terminal candidate (step S46).

  Next, the transmitting / receiving unit 51 receives the terminal ID "01ca" as the search key used in step S42 and "online (callable)" including the operation state of the corresponding destination terminal (terminal 10ca). The terminal state information is transmitted to the request source terminal (terminal 10aa) via the communication network 2 (step S47). The transmitting / receiving unit 51 may transmit, to the request source terminal (terminal 10 aa), the terminal ID of the request source terminal (terminal 10 aa) itself and “terminal state information” indicating the operating state.

  Next, the storage / readout processing unit 19 of the request source terminal (terminal 10aa) sequentially stores the state information of the terminal received from the management system 50 in the storage unit 1000 (step S48). Therefore, the request source terminal (terminal 10 aa) can obtain the current operating status of the other terminals 10 capable of talking with the request source terminal (terminal 10 aa) by receiving the state information of each of the above terminals. it can.

  Next, the destination list creation unit 18 of the request source terminal (terminal 10 aa) reflects the state of the terminal 10 as a destination candidate based on the destination list information stored in the storage unit 1000 and the state information of the terminal. While creating the destination list 2100, the display control unit 16 causes the display 120aa shown in FIG. 1 to display the destination list 2100 as shown in FIG. 20 (step S49). In order to reflect the state of the terminal 10 in the destination list, the following processing is performed. That is, the destination list creation unit 18 extracts the corresponding visual information by searching the visual information management table (see FIG. 10) based on the operating state information of the terminal included in the state information of the terminal. Then, the destination list creation unit 18 assigns the extracted visual information to the destination list frame in the destination list information for each of the terminal ID and the destination name in the destination list information. In FIG. 20, the operating states of four destination candidates (2110, 2120, 2130, 2140) are represented by icons as an example of visual information. By this, the user can recognize the operating state of the destination candidate before starting the call.

  Note that below the destination list 2100, a return icon 2300 (an example of a third icon) for returning to the function selection screen 900 shown in FIG. 18 is displayed. Further, a scroll bar 2200 is displayed on the right side of the destination list 2100, and the user moves the scroll bar 2200 up and down to move the visual information displayed in the destination list up and down. .

<< Main effects of this embodiment >>
As described above, according to the present embodiment, it is possible to selectively use a plurality of types of call functions using communication methods in which the call control method is the same and the encoding method is different.

<< Supplement of embodiment >>
In the above embodiment, as shown in FIG. 18, the selection of two types of functions has been described. However, the present invention is not limited to this, and three or more types of functions may be selected.

In the above embodiment, the icon displayed on the display 120 by the video conference terminal as an example of the call terminal in FIGS. 18 and 20 has been described. However, as shown in FIGS. A terminal 10 'such as a smartphone may display various icons on the display 120'. FIG. 21 is a conceptual diagram showing another example of the function selection screen. FIG. 22 is a conceptual diagram showing another example of the destination list.
In FIG. 21 and FIG. 22, the terminal 10 ′, the operation button 108 ′, the microphone 114 ′, the speaker 115 ′, the display 120 ′, the function selection icon 910 ′ and the function selection icon 920 ′ are respectively connected to the terminal 10 in the video conference terminal. , Operation button 108, microphone 114, speaker 115, display 120, function selection icon 910, and function selection icon 920.

  Further, in FIG. 22, the destination list 2100 ′, the destination candidate (2110 ′, 2120 ′, 2130 ′, 2140 ′), the scroll bar 2200 ′, and the return icon 2300 ′ are respectively the destination list 2100 and the destination candidate in the video conference terminal. (2110, 2120, 2130, 2140), the scroll bar 2200, and the back icon 2300.

  In addition, various icons shown in FIG. 10, FIG. 18 and FIG. 20 may include not only pictorial symbols but also letters and symbols in pictorial symbols.

  Furthermore, although transmission and reception of image data and audio data have been described in the above embodiment, the present invention is not limited to this. Only voice data may be transmitted and received. In this case, although the merits of the videophone can not be utilized, it is possible to make a call-only conference as in the case of a normal telephone.

  Further, the relay device 30, the management system 50, the program providing system 90, and the maintenance system 100 in the above embodiment may be constructed by a single computer, or each part (function or means) is divided and arbitrarily assigned. It may be built by multiple computers. Also, in the case where the program providing system 90 is constructed by a single computer, the program sent by the program providing system 90 may be divided into a plurality of modules and may be sent separately. It may be sent. Furthermore, when the program providing system 90 is constructed by a plurality of computers, the plurality of modules may be transmitted from each computer in a separated state.

  In addition, recording media such as CD-ROMs storing the programs of the above-described embodiments, the HD 204 storing the programs, and the program providing system 90 including the HD 204 are all program products. Can be provided domestically or abroad.

  Further, although the reception date and time is managed in FIGS. 11, 13, and 15, the present invention is not limited to this, and at least the reception time of the reception date and time may be managed.

  Furthermore, in the above embodiment, although the IP address of the relay apparatus in FIG. 11 and the IP address of the terminal in FIG. 13 are managed, the present invention is not limited to this, and to specify the relay apparatus 30 on the communication network 2 The respective FQDN (Fully Qualified Domain Name) may be managed as long as it is destination information for identifying the terminal 10 on the communication network 2. In this case, an IP address corresponding to the FQDN is acquired by a well-known DNS (Domain Name System) server.

  Further, in the above embodiment, the case of the video conference system has been described as an example of the call system 1. However, the present invention is not limited to this, and may be a telephone system such as an IP (Internet Protocol) telephone or an Internet telephone. . Further, the call system 1 may be a car navigation system. In this case, for example, one of the terminals 10 corresponds to a car navigation device mounted in a car, and the other of the terminals 10 is mounted in a management terminal or management server of a management center that manages car navigation, or in another car. Corresponds to a car navigation system. Further, the call system 1 may be a communication system of a mobile phone. In this case, for example, the terminal 10 corresponds to a mobile phone.

  Moreover, although the said embodiment demonstrated image data and audio | voice data as an example of telephone call data, it does not restrict to this and may be tactile (touch) data. In this case, the feeling that the user has touched on one of the terminals is called to the other terminal. Furthermore, the call data may be smell data. In this case, the smell on one terminal side is called to the other terminal side. Also, the call data may be at least one of image data, voice data, tactile data, and olfactory data.

  Further, in the above embodiment, although the case of making a video conference by the call system 1 has been described, the present invention is not limited to this, and general conversations such as meetings, family and friends, or information in one direction It may be used for presentation.

  The appearance of the call terminal of the terminal shown in FIG. 6 is merely an example, and may be a smartphone, a tablet terminal, a mobile phone, or a general-purpose PC. The microphone and the camera do not necessarily have to be built in, and may be external.

Also, in FIG. 2 and FIG. 4, the call control method of the request source terminal is the instant messenger protocol (or a protocol obtained by extending the instant messenger protocol), and in FIG. 4 the call control method of the destination terminal is SIP (Session Initiation). Although described as Protocol) or H.323, this is merely an example and may be any of the call control methods other than the above.

1 call system 10 call terminal 11 transmitting / receiving unit (an example of transmitting means, an example of receiving means)
12 Operation input acceptance unit (an example of acceptance means)
16 Display control unit (an example of display control means)
17 Starting part (an example of starting means)
18 Destination List Generator 30 Relay Device 50 Call Management System 90 Program Providing System 100 Maintenance System 910 Function Selection Icon (Example of the First Icon)
920 function selection icon (an example of the second icon)
1000 storage unit 1001 visual information management DB (an example of visual information management means)
2300 back icon (an example of the third icon)
5000 storage unit (an example of storage means)
5001 Relay Device Management DB
5002 Terminal Authentication Management DB
5003 Terminal State Management DB
5004 Destination List Management DB
5005 Session Management DB

JP 2008-227577 A JP 2001-326972 A

Claims (12)

Code by a first communication function and the first video coding scheme and the second video Naru different encoding method for communicating video data encoded by the encoding method of the first image and another terminal A terminal having a second communication function of communicating the digitized video data with another terminal ,
Selection of the first communication function or the second communication function after logging in to the management system that manages the destination candidate that is the communication destination of the video data and the state information in association with the identification information based on the identification information Accepting means for accepting from the user,
Activate the first communication function when the selection of the first communication function is accepted, or activate the second communication function when the selection of the second communication function is accepted Starting means,
The second communication function is being activated to update status information indicating online associated with the identification information managed in the management system when the selection of the second communication function is accepted. Transmission means for transmitting status information indicating that there is
When the selection of the first communication function is received, a reception unit configured from said management system, to receive the state information associated with the identification information and the identification information corresponding to the destination candidate,
Display control means for causing a display means to display a destination candidate provided with the first communication function and the second communication function based on identification information corresponding to the destination candidate;
Have
The display control means
When the destination candidate activates the first communication function, the first visual information is displayed in association with the destination candidate based on status information indicating online;
When the destination candidate activates the second communication function, the second visual function is visually different from the first visual information based on state information indicating that the second communication function is activated . Displaying the second visual information in association with the destination candidate ;
Of the destination candidates displayed on the display unit, the terminal characterized that you initiate communication with the said first visual information and association with the displayed destination candidates first communication function. It said display control means further pre Symbol first communication function, and a function selection screen for accepting selection of pre-Symbol second communication function before starting communication with another terminal, to said display means hand stage to display Te
Terminal according to claim 1, characterized in that it comprises a. The display control means causes an icon capable of accepting display of the function selection screen to be displayed on a selection screen for selecting the destination candidate displayed on the display means .
The terminal according to claim 2 , wherein when the selection of the icon is accepted by the acceptance means, the display control means causes the display means to display the function selection screen. The terminal according to any one of claims 1 to 3 , which transmits and receives sound data to and from another terminal. The coding method of the first video is H.264 / SVC, coding scheme of the second image may be any of claims 1 to 4, characterized in that the H.264 / AVC The terminal according to one item. The transmission means, when the first communication function is activated by the activation means, transmits the video data encoded using the first video encoding method to the other through the relay apparatus. When transmitted to a terminal and the second communication function is activated by the activation means, the video data encoded using the second video encoding method is directly transmitted to the other terminal The terminal according to any one of claims 1 to 5 , characterized in that. The first communication function and the second communication function establish a session for transmitting and receiving the video data by using the same call control method in any one of the first to sixth aspects. Terminal described in.   The first communication function is realized by a first communication application of the terminal, and the second communication function is realized by a second communication application different from the first communication application of the terminal. The terminal according to any one of claims 1 to 7, characterized by The terminal according to any one of claims 1 to 8 , wherein the terminal is a video conference terminal. A first communication function for communicating video data encoded by a first video coding method with another terminal and a second video coding method different from the first video coding method A display method executed by a terminal having a second communication function of communicating the selected video data with another terminal ,
The terminal is
Selection of the first communication function or the second communication function after logging in to the management system that manages the destination candidate that is the communication destination of the video data and the state information in association with the identification information based on the identification information Accepting step from the user,
Activate the first communication function when the selection of the first communication function is accepted, or activate the second communication function when the selection of the second communication function is accepted Starting step,
The second communication function is being activated to update status information indicating online associated with the identification information managed in the management system when the selection of the second communication function is accepted. A transmitting step of transmitting status information indicating that there is
When the selection of the first communication function is received, a receiving step from said management system, to receive the state information associated with the identification information and the identification information corresponding to the destination candidate,
A display step of causing a display means to display a destination candidate having the first communication function and the second communication function based on identification information corresponding to the destination candidate;
Run
The display step is
When the destination candidate activates the first communication function, the first visual information is displayed in association with the destination candidate based on status information indicating online;
When the destination candidate activates the second communication function, the second visual function is visually different from the first visual information based on state information indicating that the second communication function is activated . Displaying the second visual information in association with the destination candidate ;
Of the destination candidates displayed on the display means, characterized in that it comprises a you start a communication process by using the first communication function with the first visual information and association with the displayed destination candidates Display method. A program causing a computer to execute the method according to claim 10 . A first communication function for communicating video data encoded by a first video coding method with another terminal and a second video coding method different from the first video coding method A communication system comprising: a terminal having a second communication function for communicating the selected video data with another terminal; and a management system for connecting via a network,
The management system
A management unit that manages, in association with identification information, destination candidates which are communication destinations of the video data and status information;
In the terminal logged in to the management system based on the identification information, when the selection of the second communication function is received from the user, the state information indicating that the second communication function is being activated is logged in Receiving means for receiving from the above-mentioned terminal;
Updating means for updating state information associated with identification information corresponding to the logged-in terminal from state information indicating online to state information indicating that the received second communication function is activated;
In the terminal logged in, in response to a request transmitted when the selection of the first communication function is accepted, the login of identification information corresponding to the destination candidate and state information associated with the identification information Sending means for sending to the
Have
The terminal is
Display control means for causing a display means to display a destination candidate provided with the first communication function and the second communication function based on identification information corresponding to the destination candidate received from the management system;
Have
The display control means
When the destination candidate activates the first communication function, the first visual information is displayed in association with the destination candidate based on status information indicating online;
When the destination candidate activates the second communication function, the second visual function is visually different from the first visual information based on state information indicating that the second communication function is activated. Displaying the second visual information in association with the destination candidate;
The terminal is characterized in that, among the destination candidates displayed on the display means, communication is started using the destination candidate displayed in association with the first visual information and the first communication function. Communications system.