JP7060543B2 - Terminal, communication function activation method, communication system and program - Google Patents

Description

The present invention relates to an invention for activating any of a plurality of call functions of different call methods.

In recent years, in response to a request to reduce business trip expenses and business trip time, a telephone system for conducting a video conference or the like via a communication network such as the Internet has become widespread. By using such a call system, image data and voice data can be transmitted and received between a plurality of call terminals, and a video conference can be held (see Patent Document 1).

On the other hand, one call terminal is equipped with two types of call functions that use two different types of communication methods, such as PDC (Personal Digital Cellular) method and PHS (Personal Handyphone System), and these two types of communication methods can be used. A videophone system that makes a call by switching has been proposed (see Patent Document 2).

However, the two conventional communication methods differ in both the call control method for connecting or disconnecting from the destination of the call and the coding method for encoding the call data. That is, in the conventional telephone terminal, two types of communication functions using completely different communication methods are mounted in one housing, and only one function is operated exclusively. Therefore, there is a problem that it is not possible to properly use a plurality of types of communication functions using communication methods having the same call control method but different coding methods.

The invention according to claim 1 has a first communication function for communicating video data with another terminal by the first communication method, and the first communication function and the call control method having the same call control method as the first communication method. At least a terminal capable of activating a second communication function for communicating video data with another terminal by a second communication method having a different coding method for the video data, and information on other terminals including online. After logging in to the management system to be managed, a receiving means for receiving the information of the other terminal from the management system, a display control means for displaying the information of the other terminal on the display means, and video data with the other terminal. The first icon for activating the first communication function displayed on the display means by the display control means and the second for activating the second communication function before starting the communication by the display means. On the function selection screen including the icon, the reception means for accepting the selection of either the first icon or the second icon, and the first when the selection of the first icon is accepted. It has an activation means for activating the communication function and activating the second communication function when the selection of the second icon is accepted, and the first communication activated by the activation means. Regardless of whether communication is started by the function or the second communication function, the first communication function or the second communication function selected on the function selection screen is activated by the activation means. It is a terminal characterized by starting communication by video data with the other terminal by transmitting a communication start request using a communication session established with the management system in the state.

As described above, according to the present invention, there is an effect that a plurality of types of communication functions using communication methods having the same call control method but different coding methods can be used properly.

It is a schematic diagram of the call system which concerns on one Embodiment of this invention. It is a conceptual diagram which shows the communication state in the case of realizing a call between the call terminals having a dedicated terminal function. FIG. 3 is a conceptual diagram showing the image quality of image data transmitted and received according to the SVC standard in FIG. 2. It is a conceptual diagram which showed the communication state in the case of realizing a call between the call terminals having a non-dedicated terminal function. FIG. 3 is a conceptual diagram showing the image quality of image data transmitted and received according to the AVC standard in FIG. It is an external view of the call terminal which concerns on this embodiment. It is a hardware block diagram of the call terminal which concerns on this embodiment. It is a hardware block diagram of the call management system, the relay device, the program providing system, or the maintenance system which concerns on this embodiment. It is a functional block diagram of a call terminal, a relay device, and a call management system that form a part of the call system of the embodiment. It is a conceptual diagram which shows the visual information management table. It is a conceptual diagram which shows the relay device management table. It is a conceptual diagram which shows the terminal authentication management table. It is a conceptual diagram which shows the terminal state management table. It is a conceptual diagram which shows the destination list management table. It is a conceptual diagram which shows the session management table. It is a sequence diagram which shows the process of the preparatory stage to start a call between terminals. It is a flowchart which showed the process of selecting a dedicated terminal function or a non-dedicated terminal function. It is a conceptual diagram which shows the call function selection screen. It is a flowchart which showed the process of displaying a destination list. It is a conceptual diagram which shows the destination list. It is a conceptual diagram which shows the other example of a function selection screen. It is a conceptual diagram which shows the other example of a destination list.

Hereinafter, an embodiment of the present invention will be described with reference to FIGS. 1 to 20.

<< Overall configuration of the embodiment >>
FIG. 1 is a schematic diagram of a telephone system according to an embodiment of the present invention. As shown in FIG. 1, the call system 1 includes a plurality of call terminals (10aa, 10ab, ...), a display (120aa, 120ab, ...) For each call terminal (10aa, 10ab, ...), And a plurality of. It is constructed by a relay device (30a, 30b, 30c), a call management system 50, a program providing system 90, and a maintenance system 100. By communicating image data and sound data as an example of call data by the call system 1, it is possible to realize a video conference between remote locations. The plurality of routers (70a, 70b, 70c, 70d, 70ab, 70cd) select the optimum route of the call data.

Further, the telephone terminal (10aa, 10ab, 10ac, ...), The relay device 30a, and the router 70a are communicably connected by LAN2a. The call terminal (10ba, 10bb, 10bc, ...), The relay device 30b, and the router 70b are communicably connected by LAN2b. Further, LAN2a and LAN2b are communicably connected by a dedicated line 2ab including a router 70ab. Further, the LAN 2a, the LAN 2b, and the leased line 2ab are constructed in the predetermined area X. For example, region X is Japan, LAN2a is built in a business office in Tokyo, and LAN2b is built in a business office in Osaka.

On the other hand, the telephone terminal (10ca, 10cc, 10cc, ...), The relay device 30c, and the router 70c are communicably connected by LAN2c. The call terminal 10d (10da, 10db, 10dc, ...), The relay device 30d, and the router 70d are communicably connected by LAN2d. Further, LAN2c and LAN2d are communicably connected by a dedicated line 2cd including a router 70cd. Further, the LAN 2c, the LAN 2d, and the leased line 2cd are constructed in the predetermined area Y. For example, region Y is the United States, LAN2c is built in a New York office, and LAN2d is Washington D.C. C. It is built in the office of. Region X and region Y are connected to each other from routers (70ab, 70cd) so as to be able to communicate with each other via the Internet 2i.

In the following, the "call terminal" is simply represented as a "terminal", and the "call management system" is simply represented as a "management system". Further, any terminal among the plurality of terminals (10aa, 10ab, ...) Is represented as "terminal 10", and any display among the plurality of displays (120aa, 120ab, ...) Is represented as "display 120". , Any relay device among the plurality of relay devices (30a, 30b, 30c) is represented as "relay device 30". Further, the terminal as the request source for requesting the start of the video conference is represented as the "request source terminal", and the terminal as the destination (relay destination) which is the request destination is represented as the "destination terminal". Further, any router among the routers (70a, 70b, 70c, 70d, 70ab, 70cd) is represented as "router 70".

Further, the management system 50, the program providing system 90, and the maintenance system 100 are connected to the Internet 2i. The management system 50, the program provision system 90, and the maintenance system 100 may be installed in the area X or the area Y, or may be installed in an area other than these.

Further, in the present embodiment, the communication network 2 of the present embodiment is constructed by the LAN2a, LAN2b, the leased line 2ab, the Internet 2i, the leased line 2cd, the LAN2c, and the LAN2d. The communication network 2 may have a place where wireless communication such as WiFi (Wireless Fidelity) or Bluetooth (registered trademark) is performed as well as wired communication.

Further, in FIG. 1, the four sets of numbers shown under each terminal 10, each relay device 30, management system 50, router 70, program providing system 90, and maintenance system 100 are in general IPv4. The IP address is simply shown. For example, the IP address of the terminal 10aa is "1.2.1.3". Further, IPv6 may be used instead of IPv4, but for the sake of simplification of the explanation, IPv4 is used for the explanation.

It should be noted that each terminal 10 can be used not only for calls between a plurality of business establishments and between different rooms in the same business establishment, but also for calls within the same room, outdoors and indoors, or outdoors and outdoors. May be used. When each terminal 10 is used outdoors, wireless communication such as a mobile phone communication network is performed.

Further, each terminal 10 shown in FIG. 1 is a terminal that realizes a user's call by transmitting and receiving call data, and is, for example, a video conference terminal. Further, the terminal 10 transmits / receives call data by using a predetermined communication method (a call control method for connecting or disconnecting a call destination and a coding method for converting call data into an IP packet). conduct.

The call control method includes (1) SIP (Session Initiation Protocol), (2) H.323, (3) SIP extension protocol, (4) instant messenger protocol, and (5) SIP MESSAGE method. (6) Internet Relay Chat protocol (IRC), (7) instant messenger protocol extended protocol, etc. Of these, (4) instant messenger protocols are, for example, (4-1) XMPP (Extensible Messaging and Presence Protocol), or (4-2) ICQ (registered trademark), AIM (registered trademark), or Skype (registered). It is a protocol used in (trademark) and the like. (7) A protocol that extends the instant messenger protocol is, for example, Jingle.

Further, among the plurality of terminals 10, for example, a communication method in which the call control method is an instant messenger protocol (or a protocol extended from the instant messenger protocol) and the coding method is SVC (Scalable Video Coding) is used. The terminal 10 to be used is represented as a “dedicated terminal”. Further, among the plurality of terminals 10, the terminal 10 that uses a communication method in which the call control method and the coding method are different from those of the dedicated terminal is represented as a “non-dedicated terminal”. Further, in the present embodiment, as an example of two terminals having different communication methods, the "dedicated terminal" is described as a terminal manufactured, sold, or managed by a specific company, and the "non-dedicated terminal" is described above. Described as a terminal manufactured, sold or controlled by a company other than the above. In the present embodiment, terminals manufactured, sold, or managed by different companies in this way often have different communication methods, and thus will be described with reference to the above example. As an example of two terminals with different communication methods, among the terminals manufactured or sold by the same company, the terminal with a new manufacturing time or sales time is referred to as a "dedicated terminal", and the terminal with an old manufacturing time or sales time is referred to as "dedicated terminal". It may be a "non-dedicated terminal". Further, the dual codec compatible terminal having the dedicated terminal function and the non-dedicated terminal function communicates with the other party terminal by activating either the dedicated terminal function or the non-dedicated terminal function. That is, by activating the dedicated terminal function, it is possible to communicate using the same coding method as the dedicated terminal. By activating the non-dedicated terminal function, it is possible to communicate using the same coding method as the non-dedicated terminal.

Further, each relay device 30 is a computer system that relays call data between a plurality of terminals 10. The management system 50 is a computer system that centrally manages login authentication from the terminal 10, management of the operating state and call status of the terminal 10, management of the destination list, and the communication status of the relay device 30. The image of the image data may be a moving image or a still image, and may be both a moving image and a still image.

The program providing system 90 is a computer system that provides the programs used in each of the terminal 10, the relay device 30, the management system 50, and the maintenance system 100 to the terminal 10, the relay device 30, the management system 50, and the maintenance system 100 via the communication network 2.

The maintenance system 100 is a computer system for maintaining, managing, or maintaining at least one of the terminal 10, the relay device 30, the management system 50, and the program providing system 90. For example, when the maintenance system 100 is installed in Japan and the terminal 10, the relay device 30, the management system 50, or the program providing system 90 is installed overseas, the maintenance system 100 is remotely installed via the communication network 2. , Terminal 10, relay device 30, management system 50, and program providing system 90, and perform maintenance such as maintenance, management, and maintenance of at least one of them. Further, the maintenance system 100 includes a model number, a serial number, a sales destination, maintenance and inspection in at least one of the terminal 10, the relay device 30, the management system 50, and the program providing system 90 without going through the communication network 2. Or perform maintenance such as management of failure history.

Subsequently, with reference to FIGS. 2 and 3, a first communication pattern for realizing a call between the two terminals 10 will be described. Note that FIG. 2 is a conceptual diagram showing a communication status when a call is realized between call terminals having a dedicated terminal function. Further, the terminal 10 includes a dedicated terminal, a non-dedicated terminal, and a dual codec compatible terminal having a dedicated terminal function (an example of a first call function) and a non-dedicated terminal function (an example of a second call function). include. Here, the non-dedicated terminal refers to a terminal having a different call control method and coding method from the dedicated terminal as described above. Further, the non-dedicated terminal function refers to a terminal function having the same call control method as the dedicated terminal function but different coding methods.

Of these, the dedicated terminal and the terminal on which the dedicated terminal function is activated are exclusively used in the call system 1 that executes the first communication pattern, as shown in FIG. FIG. 2 shows a case where the requesting terminal is a terminal 10 compatible with dual codecs, the dedicated terminal function is activated, and the destination terminal is a dedicated terminal.

This call system 1 uses, for example, a communication method in which the call control method is an instant messenger protocol (or a protocol extended from the instant messenger protocol) and the coding method is H.264 / SVC (Scalable Video Coding). Then, the call data is communicated. Specifically, as shown in FIG. 2, in the call system 1, management for transmitting and receiving various management information between the requesting terminal and the destination terminal via the management system 50. Communication session sei is established. This communication session sei is also a communication session for call control.

On the other hand, between the requesting terminal and the relay device 30 in which the dedicated terminal function is activated, high-resolution image data, medium-resolution image data, low-resolution image data, and audio data are used according to the SVC coding method. A first communication session sed1 for a call for sending and receiving one call data has been established. Further, between the relay device 30 and the destination terminal, four call data of high resolution image data, medium resolution image data, low resolution image data, and voice data are similarly transmitted / received by the SVC coding method. A second communication session sed2 has been established for the call.

Here, with reference to FIG. 3, the image resolution of the image data handled in the first communication pattern shown in FIG. 2 will be described. Note that FIG. 3 is a conceptual diagram showing the image quality of image data transmitted and received according to the SVC standard in FIG.

As shown in FIG. 3 (a), a low-resolution image consisting of 160 pixels in the horizontal direction and 120 pixels in the vertical direction, which is a base image, and a horizontal image as shown in FIG. 3 (b). Data of a medium-resolution image having 320 pixels and 240 pixels in the vertical direction and a high-resolution image having 640 pixels in the horizontal direction and 480 pixels in the vertical direction as shown in FIG. 3C are transmitted and received. Of these, when passing through a narrow band path, low-quality image data consisting of only low-resolution image data as a base image is relayed by the relay device 30. When the band is relatively wide, the relay device 30 relays the low-resolution image data as the base image and the medium-quality image data including the medium-resolution image data. When the band is very wide, the relay device 30 relays high-quality image data including low-resolution image data as base image quality, medium-resolution image data, and high-resolution image data. ..

Subsequently, a second communication pattern for realizing a call between the two terminals 10 will be described with reference to FIGS. 4 and 5. In addition, it is a conceptual diagram which showed the communication state in the case of realizing a call between the call terminals having a non-dedicated terminal function.

As shown in FIG. 4, the non-dedicated terminal and the terminal in which the non-dedicated terminal function is activated are exclusively used in the call system 1'that executes the second communication pattern, and are shown in FIG. As described above, the call system 1 that executes the first communication pattern cannot be used because the communication method is different from that of the dedicated terminal and the dedicated terminal function. Note that FIG. 4 shows a case where the requesting terminal is a terminal compatible with dual codecs, the non-dedicated terminal function is activated, and the destination terminal is a non-dedicated terminal.

In this call system 1', the call control method of the requesting terminal is the same instant messenger protocol as the first communication pattern (or a protocol extended from the instant messenger protocol), and the coding method is the first communication pattern. Unlike H.264 / AVC (Advanced Video Coding), the communication method is used to communicate call data. Specifically, as shown in FIG. 4, in the call system 1', a management communication session sei1 for transmitting and receiving various management information is established between the requesting terminal and the management system 50. Has been done. This communication session sei1 is also a communication session for call control. Further, when the non-dedicated terminal function is activated in the requesting terminal, the coding method is changed from SVC to AVC.

On the other hand, a communication session sei2 for call control of a non-dedicated terminal is established between the management system 50 and the destination terminal, and this call control method is different from that of the requesting terminal. For example, SIP (Session Initiation Protocol) or H.323. In this case, since the call control method differs between the request source terminal and the destination terminal, the management system 50 converts the call control method. Specifically, when the requesting terminal is activating the non-dedicated terminal function, the data related to call control is converted based on the conversion rule data used by the management system 50 to convert the call control method. And perform call control. Further, the coding method of the destination terminal (non-dedicated terminal) is the same AVC as the requesting terminal in which the non-dedicated terminal function is activated.

Further, a communication session sed for a call for transmitting and receiving call data is established between the request source terminal and the destination terminal. The communication session sed may be established directly between the requesting terminal and the destination terminal, or may be established via a relay device.

Here, with reference to FIG. 5, the image resolution of the image data handled in the second communication pattern shown in FIG. 4 will be described. Note that FIG. 5 is a conceptual diagram showing the image quality of image data transmitted and received according to the AVC standard in FIG. As shown in FIG. 5, only one image data having 320 pixels in the horizontal direction and 240 pixels in the vertical direction is transmitted / received.

<< Hardware configuration of the embodiment >>
Next, the hardware configuration of this embodiment will be described. FIG. 6 is an external view of a telephone terminal according to the present embodiment. As shown in FIG. 6, the terminal 10 includes a housing 1100, an arm 1200, and a camera housing 1300. Of these, the front side wall surface 1110 of the housing 1100 is provided with an intake surface (not shown) formed by a plurality of intake holes, and the rear side wall surface 1120 of the housing 1100 is formed with a plurality of exhaust holes. The exhaust surface 1121 is provided. As a result, by driving the cooling fan built in the housing 1100, the outside air behind the terminal 10 can be taken in through the intake surface (not shown) and exhausted to the rear of the terminal 10 through the exhaust surface 1121. A sound collecting hole 1131 is formed in the right wall surface 1130 of the housing 1100, and sounds such as voice, noise, and noise can be picked up by a built-in microphone 114 described later.

An operation panel 1150 is formed on the right side wall surface 1130 side of the housing 1100. The operation panel 1150 is provided with a plurality of operation buttons (108a to 108e) described later, a power switch 109 described later, and an alarm lamp 119 described later, and outputs sound from the built-in speaker 115 described later. A sound output surface 1151 formed by a plurality of audio output holes for passing is formed. Further, on the left side wall surface 1140 side of the housing 1100, an accommodating portion 1160 as a recess for accommodating the arm 1200 and the camera housing 1300 is formed. The right wall surface 1130 of the housing 1100 is provided with a plurality of connection ports (1132a to 1132c) for electrically connecting a cable to the external device connection I / F 118 described later. On the other hand, the left wall surface 1140 of the housing 1100 is provided with a connection port (not shown) for electrically connecting the cable 120c for the display 120 to the external device connection I / F 118 described later.

In the following, "operation button 108" is used to indicate an arbitrary operation button among the operation buttons (108a to 108e), and "operation button 108" is used to indicate an arbitrary connection port among the connection ports (1132a to 1132c). This will be described with reference to the connection port 1132.

Next, the arm 1200 is attached to the housing 1100 via the torque hinge 1210, and the arm 1200 is configured to be rotatable in the vertical direction within a tilt angle θ1 of 135 degrees with respect to the housing 1100. ing. FIG. 6 shows a state in which the tilt angle θ1 is 90 degrees. The camera housing 1300 is provided with a built-in camera 112, which will be described later, and can capture images of users, documents, rooms, and the like. Further, a torque hinge 1310 is formed in the camera housing 1300. The camera housing 1300 is attached to the arm 1200 via the torque hinge 1310. The camera housing 1300 is attached to the arm 1200 via the torque hinge 1310, and the pan angle θ2 of ± 180 degrees with respect to the arm 1200 with the state shown in FIG. 6 as 0 degree. It is configured to be rotatable in the vertical and horizontal directions within the range of ± 45 degrees and the tilt angle θ3.

Since the relay device 30, the management system 50, the program providing system 90, and the maintenance system 100 each have the same appearance as a general server / computer, the description of the appearance will be omitted.

FIG. 7 is a hardware configuration diagram of the terminal according to the present embodiment. As shown in FIG. 7, the terminal 10 of the present embodiment includes a program used to drive the CPU 101 such as a CPU (Central Processing Unit) 101 and an IPL (Initial Program Loader) that control the operation of the entire terminal 10. A stored ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103 used as a work area of the CPU 101, a flash memory 104 for storing various data such as a program for the terminal 10, image data, and audio data, and a CPU 101. SSD (Solid State Drive) 105 that controls reading or writing of various data to the flash memory 104 according to the control of the flash memory, media drive 107 that controls reading or writing (storage) of data to the recording medium 106 such as the flash memory, terminal 10. Operation button 108 operated when selecting a destination, a power switch 109 for switching the power ON / OFF of the terminal 10, and a network I / F (Interface) for data transmission using the communication network 2. ) 111 is provided.

Further, the terminal 10 has a built-in camera 112 that captures a subject and obtains image data under the control of the CPU 101, an image pickup element I / F 113 that controls the drive of the camera 112, a built-in microphone 114 that inputs voice, and voice. The built-in speaker 115 that outputs the image data, the audio input / output I / F 116 that processes the input / output of the audio signal between the microphone 114 and the speaker 115 under the control of the CPU 101, and the image data on the external display 120 under the control of the CPU 101. As shown in FIG. 5, the display I / F 117 to be transmitted, the external device connection I / F 118 for connecting various external devices, the alarm lamp 119 notifying the abnormality of various functions of the terminal 10, and the above components are shown in FIG. It is provided with a bus line 110 such as an address bus or a data bus for electrically connecting to the speaker.

The display 120 is a display unit composed of a liquid crystal display or an organic EL for displaying an image of a subject, an operation, and the like. Further, the display 120 is connected to the display I / F 117 by the cable 120c. The cable 120c may be a cable for analog RGB (VGA) signals, a cable for component video, or for HDMI (High-Definition Multimedia Interface) or DVI (Digital Video Interactive) signals. It may be a cable of. HDMI is a registered trademark.

The camera 112 includes a lens and a solid-state image sensor that converts light into electric charges to digitize an image (video) of the subject, and as solid-state image sensors, CMOS (Complementary Metal Oxide Semiconductor) or CCD (Charge Coupled Device). Etc. are used.

An external camera, an external microphone, an external speaker, etc. are connected to the external device connection I / F 118 by using a USB (Universal Serial Bus) cable or the like inserted into the connection port 1132 of the housing 1100 shown in FIG. External devices can be electrically connected to each other. When an external camera is connected, the external camera is driven in preference to the built-in camera 112 according to the control of the CPU 101. Similarly, when an external microphone is connected or an external speaker is connected, the external microphone and the external speaker are given priority over the built-in microphone 114 and the built-in speaker 115 according to the control of the CPU 101. The external speaker is driven.

The recording medium 106 has a structure that can be attached to and detached from the terminal 10. Further, as long as it is a non-volatile memory that reads or writes data under the control of the CPU 101, not only the flash memory 104 but also an EEPROM (Electrically Erasable and Programmable ROM) or the like may be used.

FIG. 8 is a hardware configuration diagram of the management system according to the present embodiment of the present invention. The management system 50 includes a CPU 201 that controls the operation of the entire management system 50, a ROM 202 that stores a program used to drive the CPU 201 such as an IPL, a RAM 203 that is used as a work area of the CPU 201, and a program for the management system 50. Media that controls reading or writing (storage) of data to recording media 206 such as HDD (Hard Disk Drive) 205 and flash memory that control reading or writing of various data to HD204 according to the control of HD204 and CPU201 that store data. Input of drive 207, display 208 for displaying various information such as cursors, menus, windows, characters, or images, network I / F 209 for data communication using communication network 2, characters, numerical values, and various instructions. Keyboard 211 with multiple keys for, mouse 212 for selecting and executing various instructions, selecting processing targets, moving the cursor, etc., CD-ROM (Compact Disc Read Only Memory) as an example of removable recording medium ) A CD-ROM drive 214 that controls reading or writing of various data to 213, and a bus line such as an address bus or a data bus for electrically connecting each of the above components as shown in FIG. It is equipped with 210.

On the other hand, since the relay device 30, the program providing system 90, and the maintenance system 100 have the same hardware configuration as the management system 50, the description thereof will be omitted. However, each HD 204 stores various data such as a program for controlling the relay device 30, the program providing system 90, and the maintenance system 100, respectively.

Each program for the terminal 10, the relay device 30, the program providing system 90, and the maintenance system 100 is a recording medium (recording medium 106, etc.) that can be read by a computer by a file in an installable format or an executable format. It may be recorded in and distributed. Further, as another example of the above-mentioned recording medium, a CD-R (Compact Disc Recordable), a DVD (Digital Versatile Disk), a Blu-ray disc, and the like can be mentioned.

<< Functional configuration of the embodiment >>
Next, the functional configuration of this embodiment will be described. FIG. 9 is a functional block diagram of a terminal 10, a relay device 30, and a management system 50 that form a part of the call system 1 of the present embodiment. In FIG. 9, the terminal 10, the relay device 30, and the management system 50 are connected so as to be able to perform data communication via the communication network 2.

<Terminal function configuration>
The terminal 10 includes a transmission / reception unit 11, an operation input reception unit 12, a login request unit 13, an image pickup unit 14, a voice input unit 15a, a voice output unit 15b, a display control unit 16, an activation unit 17, a destination list creation unit 18, and a storage unit. -Has a read processing unit 19. Each of these parts has a function realized by operating any of the components shown in FIG. 7 by an instruction from the CPU 101 according to a program for the terminal 10 expanded on the RAM 103 from the flash memory 104. Or it is a means.

Further, the terminal 10 has a storage unit 1000 constructed by the RAM 103 shown in FIG. 7 and the flash memory 104 shown in FIG. 7. In the storage unit 1000, a visual information management DB (Data Base) 1001 configured by a visual information management table described later is constructed. Further, the storage unit 1000 stores a dedicated terminal application for realizing the dedicated terminal function in the terminal 10 and a non-dedicated terminal application for realizing the non-dedicated terminal function in the terminal 10.

(Visual information management table)
FIG. 10 is a conceptual diagram showing a visual information management table. In the visual information management table, the visual information represented by the destination list displayed on the display 120 is associated and managed for each operating state information indicating the operating state of the destination terminal. Each visual information is, for example, each icon in the form as shown in FIG. Each visual information constituting the visual information management table may be sent from the management system 50 when the requesting terminal makes a login request in step S22 described later, or may be sent from the storage unit 1000 before the requesting terminal is shipped from the factory. It may be stored in.

The visual information of the present embodiment is the first visual information that visually indicates that the communication method used in the destination terminal is the communication method used in the requesting terminal (dedicated terminal), and the destination terminal. It visually indicates that the communication method used is not the communication method used by the requesting terminal (dedicated terminal), and is classified into the second visual information visually different from the first visual information. Among these, the first visual information includes visual information such as icons indicating that the operating state is online (call is possible), online (during a call), online (temporarily suspended), or offline.

Further, in the second visual information, when communication is performed between the terminals 10 having the two functions of the dedicated terminal function and the non-dedicated terminal function, the requesting terminal activates the dedicated terminal function and the destination terminal. Shows an icon or the like displayed on the display 120 on the requesting terminal side when the non-dedicated terminal function is activated.

(Each function configuration of the terminal)
Next, each functional configuration of the terminal 10 will be described in detail with reference to FIGS. 7 and 9. In the following, in explaining each functional configuration of the terminal 10, among the constituent elements shown in FIG. 7, the relationship with the main constituent elements for realizing each functional configuration of the terminal 10 will also be described. ..

The transmission / reception unit 11 of the terminal 10 shown in FIG. 9 is realized by the command from the CPU 101 shown in FIG. 7 and the network I / F 111 shown in FIG. 7, and is realized via the communication network 2 and others. Sends and receives various data (or information) to and from the terminal, device or system of. The transmission / reception unit 11 starts receiving state information indicating the state of each terminal as a destination candidate from the management system 50 even before starting a call with a desired destination terminal. It should be noted that this status information includes not only the operating status of each terminal 10 (online or offline status), but also whether it is possible to make a call even online, whether the call is in progress, whether the user is away from the desk, and the like. Shows the detailed state of. Further, this state information is not only the operating state of each terminal 10, but also the cable 120c is disconnected from the terminal 10 at the terminal 10, the sound is output but the image is not output, or the sound is not output. (MUTE), etc., showing various states. Further, the state information includes the state in which the non-dedicated terminal function is being activated as described above. In the following, as an example, a case where the state information indicates an operating state will be described.

The operation input receiving unit 12 is realized by the command from the CPU 101 shown in FIG. 7, the operation button 108 and the power switch 109 shown in FIG. 7, and receives various inputs by the user. For example, when the user turns on the power switch 109 shown in FIG. 7, the operation input receiving unit 12 shown in FIG. 9 accepts the power on and turns on the power.

The login request unit 13 is realized by a command from the CPU 101 shown in FIG. 7, and the transmission / reception unit 11 requests the management system 50 to log in via the communication network 2 when the power is turned on. The login request information indicating the above and the current IP address of the requesting terminal are automatically transmitted. Further, when the user turns off the power switch 109 from the ON state, the operation input reception unit 12 completely turns off the power after the transmission / reception unit 11 sends the state information to the management system 50 to turn off the power. do. As a result, on the management system 50 side, it is possible to know that the terminal 10 has been turned from the power on to the power off.

The image pickup unit 14 is realized by the command from the CPU 101 shown in FIG. 7 and the camera 112 and the image pickup element I / F 113 shown in FIG. 7, and the subject is imaged and the image obtained by the image pickup is taken. Output the data.

The voice input unit 15a is realized by the command from the CPU 101 shown in FIG. 7 and the voice input / output I / F 116 shown in FIG. 7, and the user's voice is converted into a voice signal by the microphone 114. After that, the voice data related to this voice signal is input. The voice output unit 15b is realized by the command from the CPU 101 shown in FIG. 7 and the voice input / output I / F 116 shown in FIG. 7, outputs the voice signal related to the voice data to the speaker, and outputs the voice signal to the speaker 115. Output audio from.

The display control unit 16 is realized by the command from the CPU 101 shown in FIG. 7 and the display I / F 117 shown in FIG. 7, and as described later, combines received image data having different resolutions. Control is performed to transmit this combined image data to the display 120. Further, the display control unit 16 can transmit the destination list information received from the management system 50 to the display 120 to display the destination list on the display 120.

Further, the display control unit 16 extracts the corresponding visual information by searching the visual information management table (see FIG. 10) using the operating state information received from the management system 50 by the transmission / reception unit 11 as a search key, and self. The display 120 of the terminal 10 is included in the destination list and displayed.

The activation unit 17 determines whether or not the transmission / reception unit 11 has received a call start request from another dedicated terminal (or another terminal for which the dedicated terminal function has been activated). Further, the activation unit 17 activates either the dedicated terminal function or the non-dedicated terminal function. Further, the activation unit 17 stops the activated dedicated terminal function or non-dedicated terminal function.

The destination list creation unit 18 displays the status of the destination candidate as shown in FIG. 20 as an icon based on the destination list information described later and the status information of the terminal 10 as each destination candidate received from the management system 50. Create and update the indicated destination list.

The storage / reading processing unit 19 is executed by the instruction from the CPU 101 shown in FIG. 7 and the SSD 105 shown in FIG. 7, or is realized by the instruction from the CPU 101, and various data are stored or stored in the storage unit 1000. A process of reading various data stored in the unit 1000 is performed. The storage unit 1000 stores a terminal ID (Identification) for identifying the terminal 10, a password, and the like. Further, the storage unit 1000 overwrites and stores the image data and the voice data received when making a call with the destination terminal every time it is received. Of these, the image is displayed on the display 120 by the image data before being overwritten, and the sound is output from the speaker 115 by the sound data before being overwritten.

The terminal ID of the present embodiment and the relay device ID described later indicate identification information such as a language, characters, symbols, or various marks used for uniquely identifying the terminal 10 and the relay device 30, respectively. Further, the terminal ID and the relay device ID may be identification information in which at least two of the above languages, characters, symbols, and various marks are combined.

<Functional configuration of relay device>
The relay device 30 has a transmission / reception unit 31 and a data quality change unit 32. Each of these parts has a function or a function realized by operating any of the components shown in FIG. 8 by a command from the CPU 201 according to a program for the relay device 30 developed on the RAM 203 from the HD 204. It is a means.

(Each function configuration of the relay device)
Next, each functional configuration of the relay device 30 will be described in detail. In the following, in explaining each functional configuration of the relay device 30, among the components shown in FIG. 8, the relationship with the main components for realizing each functional configuration of the relay device 30 is also included. explain.

The transmission / reception unit 31 of the relay device 30 shown in FIG. 9 is realized by the command from the CPU 201 shown in FIG. 8 and the network I / F 209 shown in FIG. 8, and is realized via the communication network 2. Sends and receives various data (or information) to and from other terminals, devices, or systems. As a result, the relay device 30 relays the call data between the plurality of terminals 10.

Further, the transmission / reception unit 31 instructs the destination indicated by the IP address of the requesting terminal among the IP addresses received by the transmission / reception unit 31 to start a communication session (first communication session sed1). Send session start instruction information to do. Further, the transmission / reception unit 31 starts a session for instructing the destination indicated by the IP address among the IP addresses received by the transmission / reception unit 31 to start a communication session (second communication session). The instruction information and the IP address of the destination terminal are transmitted.

The data quality changing unit 32 is realized by the command from the CPU 201 shown in FIG. 8 and changes the image quality of the image data sent from the source terminal. As a result, even if there is a delay in receiving the image data in the terminal 10 due to the mixture of the communication networks 2 or the like, the relay device 30 reduces the image quality of the image data to be relayed, thereby taking measures against the delay. It can be carried out. For example, when the reception of image data is delayed, the relay of high-resolution image data (see FIG. 3C) among the three image quality image data shown in FIG. 3 is interrupted, resulting in a delay. Take measures against.

<Functional configuration of management system>
The management system 50 includes a transmission / reception unit 51, a terminal authentication unit 52, a state management unit 53, an extraction unit 54, a determination unit 55, a session management unit 56, a conversion unit 57, and a storage / reading processing unit 59. Each of these parts has a function or a function realized by operating any of the components shown in FIG. 8 by an instruction from the CPU 201 according to a program for the management system 50 developed on the RAM 203 from the HD 204. It is a means. Further, the management system 50 has a storage unit 5000 constructed by the HD 204 shown in FIG. The storage unit 5000 stores frame data of a destination list, which will be described later, and conversion rule data used for converting a call control method.

(Relay device management table)
FIG. 11 is a conceptual diagram showing a relay device management table. In the storage unit 5000, a relay device management DB 5001 configured by a relay device management table as shown in FIG. 11 is constructed. In this relay device management table, for each relay device ID of each relay device 30, the operating status of each relay device 30, the reception date and time when the status information indicating the operating status is received by the management system 50, and the IP address of the relay device 30. , And the maximum data call speed (Mbps) in the relay device 30 are associated and managed. For example, in the relay device management table shown in FIG. 11, the relay device 30a having the relay device ID "111a" has an operating state of "online" and the date and time when the state information is received by the management system 50 is "2011". At 13:00 on November 10, 2014, it was shown that the IP address of the relay device 30a is "1.2.1.2" and the maximum data call speed of the relay device 30a is 100 Mbps. There is.

(Terminal authentication management table)
FIG. 12 is a conceptual diagram showing a terminal authentication management table. In the storage unit 5000, a terminal authentication management DB 5002 configured by a terminal authentication management table as shown in FIG. 12 is constructed. In this terminal authentication management table, a password for authentication is associated and managed for each terminal ID of all terminals 10 managed by the management system 50. For example, in the terminal authentication management table shown in FIG. 12, it is shown that the terminal ID of the terminal 10aa is "01aa" and the password is "aaaaa".

(Terminal state management table)
FIG. 13 is a conceptual diagram showing a terminal state management table. In the storage unit 5000, a terminal state management DB 5003 configured by a terminal state management table as shown in FIG. 13 is constructed. In this terminal status management table, for each terminal ID of each terminal 10, the destination name when each terminal 10 is the destination, the operating status of each terminal 10, and the reception date and time when the login request information described later is received by the management system 50. , And the IP address of the terminal 10 are associated and managed. For example, in the terminal status management table shown in FIG. 13, the terminal 10aa with the terminal ID "01aa" has the terminal name "Japan Tokyo Office AA terminal" and the operating status "online (call is possible)". , It is shown that the date and time when the login request information was received by the management system 50 is "13:40 on November 10, 2011", and the IP address of this terminal 10aa is "1.2.1.3". Has been done.

However, in the terminal status management table, terminal information including the terminal ID, terminal name, operating status, reception date and time, and IP address of the non-dedicated terminal 10 (that is, a terminal having a dedicated terminal function and a terminal other than the dedicated terminal) is managed. It is not managed because it is out of scope.

(Destination list management table)
FIG. 14 is a conceptual diagram showing a destination list management table. In the storage unit 5000, a destination list management DB 5004 configured by a destination list management table as shown in FIG. 14 is constructed. In this destination list management table, all the terminal IDs of the destination terminals registered as candidates for the destination terminal are associated and managed with the terminal ID of the requesting terminal that requests the start of the call. For example, in the destination list management table shown in FIG. 14, a candidate for a destination terminal that can request the start of a call from a requesting terminal (terminal 10aa) having a terminal ID of "01aa" has a terminal ID of "01aa". It is shown that the terminal 10ab of "01ab", the terminal 10ba of the terminal ID "01ba", the terminal 10bb of the terminal ID "01bb", and the like. The candidate of the destination terminal is updated by being added or deleted by a request for addition or deletion to the management system 50 from an arbitrary requesting terminal. In the destination list management table (see FIG. 14) as in the terminal status management table, the terminal IDs of non-dedicated terminals are not managed because they are not managed.

(Session management table)
FIG. 15 is a conceptual diagram showing a session management table. In the storage unit 5000, a session management DB 5005 configured by a session management table as shown in FIG. 15 is constructed. In this session management table, the relay device ID of the relay device 30 used for relaying call data (image data and voice data), the terminal ID of the requesting terminal, the terminal ID of the destination terminal, and the image data are received at the destination terminal. The reception delay time (ms) at the time of reception and the reception date and time when the delay time information indicating the delay time is sent from the destination terminal and received by the management system 50 are managed in association with each other.

For example, in the session management table shown in FIG. 15, the relay device 30a (relay device ID "111a") has a requesting terminal (terminal 10aa) having a terminal ID of "01aa" and a terminal ID of "01ca". Image data and audio data are relayed to and from the destination terminal (terminal 10ca), and the delay time of the image data at the destination terminal (terminal 10ca) as of "14:00 on November 10, 2011". It is shown to be 200 (ms). When making a call between the two terminals 10, the reception date and time of the delay time information may be managed based on the delay time information transmitted from the requesting terminal instead of the destination terminal. However, when a call is made between three or more terminals 10, the reception date and time of the delay time information is managed based on the delay time information transmitted from the terminal 10 on the receiving side of the image data and the audio data. ..

(Each function configuration of the management system)
Next, each functional configuration of the management system 50 will be described in detail. In the following, in explaining each functional configuration of the management system 50, among the constituent elements shown in FIG. 8, the relationship with the main constituent elements for realizing each functional configuration of the management system 50 is also included. explain.

The transmission / reception unit 51 is executed by the instruction from the CPU 201 shown in FIG. 8 and the network I / F 209 shown in FIG. 8, and various data (various data) with other terminals, devices or systems via the communication network 2. Or information) is sent and received.

The terminal authentication unit 52 is realized by a command from the CPU 201 shown in FIG. 8, and uses the terminal ID and password included in the login request information received via the transmission / reception unit 51 as search keys for terminal authentication management. Terminal authentication is performed by searching the table (see FIG. 12) and determining whether the same terminal ID and password are managed in this terminal authentication management table.

The state management unit 53 is realized by the command from the CPU 201 shown in FIG. 8, and in order to manage the operating state of the requesting terminal that has made a login request, the state management unit 53 puts this requesting source in the terminal state management table (see FIG. 13). The terminal ID of the terminal, the operating status of the requesting terminal, the reception date and time when the login request information is received by the management system 50, and the IP address of the requesting terminal are stored and managed in association with each other. Further, the state management unit 53 changes the state of the power switch 109 of the terminal 10 from on to off, and the state management unit 53 determines the terminal state based on the state information sent from the terminal 10 to turn off the power. The operating status indicating online of the management table (see FIG. 13) is changed to offline.

The extraction unit 54 is realized by an instruction from the CPU 201 shown in FIG. 8, searches for each management DB built in the storage unit 5000 by various search keys, and obtains data (information) corresponding to the search keys. Extract as a search result.

For example, the extraction unit 54 searches the destination list management table (see FIG. 14) using the terminal ID of the requesting terminal that requested login as a key, and obtains a candidate terminal ID of the destination terminal that can make a call with the requesting terminal. Extract. Further, the extraction unit 54 searches the terminal status table (see FIG. 13) using the terminal ID of the candidate terminal of the destination terminal as a search key, and extracts the operating status for each terminal ID. As a result, the extraction unit 54 can acquire the operating state of the candidate of the destination terminal that can make a call with the request source terminal that has requested the login.

Further, the extraction unit 54 searches the destination list management table (see FIG. 14) using the terminal ID of the requesting terminal that has requested login as a key, and registers the terminal ID of the requesting terminal as a candidate for the destination terminal. The terminal IDs of other requesting terminals are also extracted. Further, the extraction unit 54 searches the terminal status management table (see FIG. 13) using the terminal ID as a search key, and also acquires the operating status of the requesting terminal that has requested the login.

Further, the extraction unit 54 extracts the IP address of the corresponding terminal 10 by searching the terminal state management table (see FIG. 13) using the terminal ID of the terminal 10 received by the transmission / reception unit 51 as a search key. Further, the extraction unit 54 extracts the corresponding terminal ID by searching the terminal state management table (see FIG. 13) using the IP address of the destination terminal as a search key.

Subsequently, the determination unit 55 determines whether or not the operating state, which is realized by the command from the CPU 201 shown in FIG. 8 and is indicated by the operating state information, is “online”. Further, the determination unit 55 determines that the operating status information can be transmitted to the predetermined terminal 10 when it is determined to be "online", and when it is determined that it is not "online", the predetermined terminal It is determined that the operation status information cannot be transmitted to 10.

The session management unit 56 is realized by an instruction from the CPU 201 shown in FIG. 8, and the relay device ID of the relay device 30 used for relaying call data is displayed in the session management table (see FIG. 15) of the storage unit 5000. , The terminal ID of the requesting terminal, the terminal ID of the destination terminal, the delay time (ms) of reception when the image data is received at the destination terminal, and the delay time information indicating this delay time are sent from the destination terminal. The received date and time received by the management system 50 is stored and managed in association with each other. In addition, the session management unit 56 creates a session ID used to establish a communication session.

When the conversion unit 57 indicates in the terminal status management table that the operating state corresponding to the terminal ID of the requesting terminal has activated the non-dedicated terminal function, the conversion unit 57 calls according to the conversion rule data stored in the storage unit 5000 in advance. Control is executed, and the call control method transmitted from the requesting terminal and the call control method transmitted from the destination terminal are mutually converted.

The storage / reading processing unit 59 is executed by the instruction from the CPU 201 shown in FIG. 8 and the HDD 205 shown in FIG. 8, and various data are stored in the storage unit 5000 or stored in the storage unit 5000. Performs the process of reading various data.

<< Processing or operation of the embodiment >>
Subsequently, the case where the terminal 10 having the dedicated terminal function and the non-dedicated terminal function is the requesting terminal will be described with reference to FIGS. 6, 9, and 16 to 20. Note that FIG. 16 is a sequence diagram showing a call start request.

As shown in FIG. 16, first, when the user of the requesting terminal (terminal 10aa) corresponding to the dual codec turns on the power switch 109 shown in FIG. 6, it is shown in FIG. The operation input receiving unit 12 receives the power on and turns on the power (step S21). Then, the login request unit 13 automatically transmits the login request information indicating the login request from the transmission / reception unit 11 to the management system 50 via the communication network 2 when the power is turned on (step S22). This login request information includes a terminal ID and a password for identifying the terminal 10aa which is the request source terminal. These terminal IDs and passwords are data read from the storage unit 1000 via the storage / reading processing unit 19 and sent to the transmission / reception unit 11. When the login request information is transmitted from the request source terminal (terminal 10aa) to the management system 50, the management system 50 on the receiving side can grasp the IP address of the terminal 10aa on the transmitting side.

Next, the terminal authentication unit 52 of the management system 50 searches the terminal authentication management table (see FIG. 12) using the terminal ID and password included in the login request information received via the transmission / reception unit 51 as search keys. , Terminal authentication is performed by determining whether the same terminal ID and the same password are managed in this terminal authentication management table (step S23). Since the same terminal ID and the same password are managed by the terminal authentication unit 52, if it is determined that the login request is from the terminal 10 having a legitimate usage authority, the state management unit 53 will perform the status management unit 53. In the terminal status management table (see FIG. 13), the operating status, the date and time when the login request information was received, and the IP address of the terminal 10aa are stored in association with each record indicated by the terminal ID and destination name of the terminal 10aa. (Step S24). As a result, in the terminal status management table, the terminal ID "01aa", the destination name, the operating status "online", the reception date and time "2011.11.10.13: 40", and the terminal IP address "1.2.1. 3 ”will be associated and managed.

Then, the transmission / reception unit 51 of the management system 50 requests the login of the authentication result information showing the authentication result obtained by the terminal authentication unit 52 via the communication network 2 (terminal 10aa). (Step S25). In the present embodiment, the case where the terminal authentication unit 52 determines that the terminal has a proper usage authority will be continuously described below.

The extraction unit 54 of the management system 50 searches the destination list management table (see FIG. 14) based on the terminal ID "01aa" of the requesting terminal (terminal 10aa) that has made a login request, thereby causing the requesting terminal (terminal). The terminal ID of another requesting terminal that has registered the terminal ID "01aa" of 10aa) as a candidate for the destination terminal is extracted (step S26). Here, for the sake of simplification of the description, the case where the terminal ID extracted in step S26 is the terminal ID “01ba” of the terminal 10ba will be continuously described below.

Next, the extraction unit 54 of the management system 50 searches the terminal state management table (see FIG. 13) using the terminal ID "01aa" of the requesting terminal (terminal 10aa) that has made the login request as a search key. The operating state of the requesting terminal (terminal 10aa) that has requested login is extracted (step S27).

Next, the transmission / reception unit 51 includes the terminal ID "01aa" of the requesting terminal (terminal 10aa) and the operating state information indicating the operating state of the requesting terminal (terminal 10aa) with respect to the terminal 10ba. "Terminal status information" is transmitted (step S28). As a result, the transmission / reception unit of the terminal 10ca receives the state information of the terminal. Therefore, in the terminal 10ba, a destination list reflecting the latest operating state of the terminal 10aa is created and displayed on the display 120ba, as in the process of step S28 described later.

On the other hand, in the requesting terminal (terminal 10aa), the selection process of either the dedicated terminal function or the non-dedicated terminal function is performed (step S29). Here, the function selection process will be described in more detail with reference to FIG. Note that FIG. 17 is a flowchart showing a process of selecting the dedicated terminal function or the non-dedicated terminal function.

First, the display control unit 16 of the requesting terminal (terminal 10aa) causes the display 120aa to display the function selection screen 900 as shown in FIG. 18 (step S29-1). Note that FIG. 18 is a conceptual diagram showing a call function selection screen. As shown in FIG. 18, on the function selection screen 900, a function selection icon 910 (an example of the first icon) for activating the dedicated terminal function and a function selection for activating the non-dedicated terminal function are displayed. The icon 920 (an example of the second icon) is displayed in parallel. Further, on the lower right side of the function selection screen 900, an end icon 990 for ending the function selection process is displayed.

Next, the operation input receiving unit 12 of the requesting terminal (terminal 10aa) determines whether the function selection icon 910 or the function selection icon 920 shown in FIG. 18 is selected by the user (step). S29-2). If it is determined by step S29-2 that none of the icons has been selected, the transmission / reception unit 11 is further moved from another dedicated terminal (or another terminal in which the dedicated terminal function is activated). It is determined whether or not the call start request has been accepted (step S29-3). Then, if it is determined by step S29-3 that the call start request is not accepted (NO), the process returns to the process of step S29-1. On the other hand, if it is determined in step S29-3 that the call start request has been accepted (YES), the activation unit 17 activates the dedicated terminal function (step S29-4). As a result, the terminal 10aa can start a call as a dedicated terminal.

Further, when it is determined in step S29-2 that either the function selection icon 910 or the function selection icon 920 is selected, the operation input receiving unit 12 further activates the dedicated terminal function. It is determined whether or not the selection icon 910 is selected (step S29-5). When it is determined in step S29-5 that the function selection icon 910 has been selected, the activation unit 17 activates the dedicated terminal function (step S29-6). In this case, the terminal 10aa can start a call as a dedicated terminal through steps S41 to S49 described later.

On the other hand, if it is determined in step S29-5 that the function selection icon 910 was not selected (the function selection icon 920 was selected), the transmission / reception unit 11 of the requesting terminal (terminal 10aa) is managed. The terminal status information indicating that the non-dedicated terminal function is being activated is transmitted to the system 50 (step S29-7). By this transmission, the management system 50 updates the operating state of the terminal ID corresponding to the terminal 10aa in the terminal state management table to a state indicating that the non-dedicated terminal function is being activated. Further, the activation unit 17 of the requesting terminal (terminal 10aa) activates the non-dedicated terminal function (step S29-8). However, when the requesting terminal (terminal 10aa) operates as a non-dedicated terminal, the destination list described later as shown in FIG. 20 is not displayed, so that the user can specify the destination to specify the destination terminal. You must enter the address information (for example, IP address) that can identify the location of. Therefore, when the user inputs, for example, the IP address of the destination terminal (non-dedicated terminal), the operation input receiving unit 12 accepts the designation of the destination (step S29-9). As a result, the requesting terminal (terminal 10aa) can start a call as a non-dedicated terminal.

Specifically, the requesting terminal sends a call start request addressed to the input IP address to the management system 50, and in the management system 50, the operating state of the terminal ID of the requesting terminal is determined in the terminal status management table. Since it indicates that the non-dedicated terminal function is running, the conversion unit 57 converts the received call start request into data according to the conversion data rules (that is, according to the call control method of the non-dedicated terminal). .. The converted call start request is transmitted to the destination terminal (non-dedicated terminal) based on the IP address received from the management system 50. The destination terminal (non-dedicated terminal) that has received the call start request responds to the management system 50 if the call is possible, and the management system 50 converts the call start request according to the conversion data rule in the same manner as the call start request. Transfers the response to the requesting terminal. By a series of call control processes, a communication session sed can be established between the requesting terminal and the destination terminal as shown in FIG. In the case of FIG. 4, since the requesting terminal is activating the non-dedicated terminal function, the same AVC coding method as the destination terminal (non-dedicated terminal) is used as the coding method.

In step S29-9, the user was asked to input the IP address, but the terminal 10 stores the location information such as the IP address of the non-dedicated terminal in advance so that the user can select from the location information. You may.

Subsequently, the process from the process of step S29-6 shown in FIG. 17 to the start of the call will be described with reference to FIGS. 19 and 20. Note that FIG. 19 is a flowchart showing a process of displaying the destination list. Further, FIG. 20 is a conceptual diagram showing a destination list.

First, when the requesting terminal (terminal 10aa) receives the authentication result information indicating the result determined by the step S25 as a terminal having a legitimate usage authority, the transmission / reception unit 11 passes through the communication network 2. The destination list request information indicating that the destination list is requested is transmitted to the management system 50 (step S41). As a result, the transmission / reception unit 51 of the management system 50 receives the destination list request information.

Next, the extraction unit 54 of the management system 50 searches the destination list management table (see FIG. 14) using the terminal ID "01aa" of the requesting terminal (terminal 10aa) requested to log in as a search key, and searches the destination list management table (see FIG. 14). A terminal ID of a candidate of a destination terminal capable of making a call with the terminal 10aa) is extracted, a terminal status management table (see FIG. 13) is searched using this terminal ID as a search key, and the corresponding destination name information is extracted. (Step S42). Here, for the sake of simplification of the description, the case where each terminal ID such as the terminal 10ab, the terminal 10ba, the terminal 10ca, and the terminal 10cc as the dedicated terminal A is extracted as the terminal 10 as the candidate terminal of the destination terminal will be continuously described below. do.

Next, the extraction unit 54 reads the data in the destination list frame from the storage unit 5000 (step S43). Then, the transmission / reception unit 51 inputs the "destination list information (destination list frame, terminal ID, destination name)" including the destination list frame and the terminal ID and destination name information extracted in step S42, to the requesting terminal (terminal). 10aa) (step S44). As a result, in the request source terminal (terminal 10aa), the transmission / reception unit 11 receives the destination list information.

Next, the storage / reading processing unit 19 of the requesting terminal (terminal 10aa) stores the destination list information in the storage unit 1000 (step S45).

As described above, in the present embodiment, the management system 50 centrally manages the destination list information of all the terminals, instead of managing the destination list information in each terminal 10. Therefore, a new terminal 10 will be used in the call system 1, a new model terminal 10 will be included in place of the already used terminal 10, and the appearance of the destination list frame will be changed. Even if this happens, the management system 50 will handle it all at once, so it is possible to save the trouble of changing the destination list information on each terminal 10.

Further, on the management system 50 side, the extraction unit 54 extracts the operating state of the terminal 10 as a candidate for the destination terminal (step S46).

Next, the transmission / reception unit 51 includes the terminal ID "01ca" as the search key used in step S42 and the operating state "online (call possible)" of the corresponding destination terminal (terminal 10ca). "Terminal status information" is transmitted to the requesting terminal (terminal 10aa) via the communication network 2 (step S47). The transmission / reception unit 51 may transmit the terminal ID of the requesting terminal (terminal 10aa) itself and "terminal status information" indicating the operating status to the requesting terminal (terminal 10aa).

Next, the storage / reading processing unit 19 of the requesting terminal (terminal 10aa) sequentially stores the state information of the terminal received from the management system 50 in the storage unit 1000 (step S48). Therefore, the requesting terminal (terminal 10aa) can acquire the current operating state of another terminal 10 capable of making a call with the requesting terminal (terminal 10aa) by receiving the status information of each of the above terminals. can.

Next, the destination list creation unit 18 of the requesting terminal (terminal 10aa) reflects the state of the terminal 10 as a destination candidate based on the destination list information stored in the storage unit 1000 and the state information of the terminal. Along with creating the destination list 2100, the display control unit 16 causes the display 120aa shown in FIG. 1 to display the destination list 2100 as shown in FIG. 20 (step S49). Further, in order to reflect the state of the terminal 10 in the destination list, the process shown below is performed. That is, the destination list creation unit 18 extracts the corresponding visual information by searching the visual information management table (see FIG. 10) based on the operating state information of the terminal included in the state information of the terminal. Then, the destination list creation unit 18 assigns the extracted visual information to the destination list frame in the destination list information for each terminal ID and destination name in the destination list information. In FIG. 20, the operating states of the four destination candidates (2110, 2120, 2130, 2140) are represented by icons as an example of visual information. As a result, the user can recognize the operating state of the destination candidate before starting the call.

A return icon 2300 (an example of a third icon) for returning to the function selection screen 900 shown in FIG. 18 is displayed below the destination list 2100. Further, a scroll bar 2200 is displayed on the right side of the destination list 2100, and when the user moves the scroll bar 2200 up and down, the visual information displayed in the destination list moves up and down. ..

<< Main effects of this embodiment >>
As described above, according to the present embodiment, there is an effect that a plurality of types of call functions using communication methods having the same call control method but different coding methods can be used properly.

<< Supplement to the embodiment >>
In the above embodiment, as shown in FIG. 18, the selection of two types of functions has been described, but the present invention is not limited to this, and three or more types of functions may be selected.

Further, in the above embodiment, in FIGS. 18 and 20, the icon displayed on the display 120 by the video conference terminal as an example of the communication terminal has been described, but as shown in FIGS. 21 and 22, the smartphone ( A terminal 10'such as a Smartphone) may display various icons on the display 120'. Note that FIG. 21 is a conceptual diagram showing another example of the function selection screen. Further, FIG. 22 is a conceptual diagram showing another example of the destination list. In FIGS. 21 and 22, the terminal 10 ′, the operation button 108 ′, the microphone 114 ′, the speaker 115 ′, the display 120 ′, the function selection icon 910 ′, and the function selection icon 920 ′ are the terminals 10 in the video conference terminal, respectively. , Operation button 108, microphone 114, speaker 115, display 120, function selection icon 910, and function selection icon 920.

Further, in FIG. 22, the destination list 2100', the destination candidate (2110', 2120', 2130', 2140'), the scroll bar 2200', and the return icon 2300'are the destination list 2100 and the destination candidate, respectively, in the video conference terminal. Corresponds to (2110, 2120, 2130, 2140), scrollbar 2200, and back icon 2300.

Further, in the various icons shown in FIGS. 10, 18, and 20, not only pictograms but also characters and symbols may be included in the pictograms.

Further, in the above embodiment, transmission / reception of image data and audio data has been described, but the present invention is not limited to this. Only voice data may be sent and received. In this case, the merit of the videophone cannot be utilized, but the conference by only the telephone is possible like the ordinary telephone.

Further, the relay device 30, the management system 50, the program providing system 90, and the maintenance system 100 in the above embodiment may be constructed by a single computer, or each part (function or means) may be divided and arbitrarily assigned. It may be built by a plurality of computers. Further, when the program providing system 90 is constructed by a single computer, the program transmitted by the program providing system 90 may or may not be divided into a plurality of modules. It may be sent. Further, when the program providing system 90 is constructed by a plurality of computers, the plurality of modules may be separated and transmitted from each computer.

Further, a recording medium such as a CD-ROM in which each program of the above embodiment is stored, an HD204 in which these programs are stored, and a program providing system 90 provided with the HD204 are all program products. Can be provided domestically or internationally.

Further, although the reception date and time are managed in FIGS. 11, 13, and 15, the reception date and time is not limited to this, and at least the reception time of the reception date and time may be managed.

Further, in the above embodiment, the IP address of the relay device is managed in FIG. 11 and the IP address of the terminal is managed in FIG. 13, but the present invention is not limited to this, and the relay device 30 is specified on the communication network 2. If it is the destination information of the above or the destination information for specifying the terminal 10 on the communication network 2, each FQDN (Fully Qualified Domain Name) may be managed. In this case, a well-known DNS (Domain Name System) server will acquire the IP address corresponding to the FQDN.

Further, in the above embodiment, the case of a video conference system has been described as an example of the call system 1, but the present invention is not limited to this, and a telephone system such as an IP (Internet Protocol) telephone or an Internet telephone may be used. .. Further, the call system 1 may be a car navigation system. In this case, for example, one of the terminals 10 corresponds to a car navigation device mounted on a car, and the other of the terminals 10 is mounted on a management terminal or a management server of a management center that manages car navigation, or another car. Corresponds to a car navigation device. Further, the communication system 1 may be a communication system of a mobile phone. In this case, for example, the terminal 10 corresponds to a mobile phone.

Further, in the above embodiment, image data and voice data have been described as an example of call data, but the present invention is not limited to this, and touch data may be used. In this case, the feeling that the user touches on one terminal side is transmitted to the other terminal side. Further, the call data may be smell data. In this case, the odor (smell) on one terminal side is transmitted to the other terminal side. Further, the call data may be at least one of image data, voice data, tactile data, and olfactory data.

Further, in the above embodiment, the case where the video conference is held by the call system 1 has been described, but the present invention is not limited to this, and the present invention is not limited to this, and is not limited to this, but is limited to meetings, general conversations between family members and friends, or information in one direction. It may be used for presentation.

Further, the external view of the telephone terminal of the terminal shown in FIG. 6 is merely an example, and may be a smartphone, a tablet terminal, a mobile phone, or a general-purpose PC. The microphone and camera do not necessarily have to be built-in, but may be external.

Further, in FIGS. 2 and 4, the call control method of the requesting terminal is the instant messenger protocol (or a protocol extended from the instant messenger protocol), and in FIG. 4, the call control method of the destination terminal is SIP (Session Initiation). Although it has been described as Protocol) or H.323, it is merely an example and may be a call control method other than the above.

1 Call system 10 Call terminal 11 Transmitter / receiver (example of transmission means, example of reception means)
12 Operation input reception unit (example of reception means)
16 Display control unit (an example of display control means)
17 Starter (an example of starter)
18 Destination list creation unit 30 Relay device 50 Call management system 90 Program provision system 100 Maintenance system 910 Function selection icon (example of the first icon)
920 function selection icon (an example of the second icon)
1000 Storage unit 1001 Visual information management DB (an example of visual information management means)
2300 Back icon (an example of the third icon)
5000 storage unit (an example of storage means)
5001 Relay device management DB
5002 Terminal authentication management DB
5003 Terminal state management DB
5004 Destination list management DB
5005 Session management DB

Japanese Unexamined Patent Publication No. 2008-22757 Japanese Unexamined Patent Publication No. 2001-326792

Claims (13)

The first communication function for communicating video data with another terminal by the first communication method , and the first communication method and at least the video data coding method having the same call control method as the first communication function. Is a terminal capable of activating a second communication function for communicating video data with another terminal by a second communication method different from the above.
A receiving means for receiving the information of the other terminal from the management system after logging in to the management system that manages the information of the other terminal including online.
A display control means for displaying the information of the other terminal on the display means, and
Before starting the communication by the video data with the other terminal, the first icon and the second communication function for activating the first communication function displayed on the display means by the display control means are displayed. A reception means that accepts the selection of either the first icon or the second icon on the function selection screen including the second icon for activation.
When the selection of the first icon is accepted, the first communication function is activated, and when the selection of the second icon is accepted, the second communication function is activated. ,
Have,
Regardless of whether communication is started by any of the first communication function and the second communication function activated by the activation means, the first communication function or the first communication function selected on the function selection screen. It is characterized in that it starts communication by video data with the other terminal by transmitting a communication start request using a communication session established with the management system in a state where the second communication function is activated by the activation means. Terminal to do. The display control means displays an icon that can be accepted to display the function selection screen on the selection screen for selecting the destination candidate that is the communication destination of the video data displayed on the display means.
The terminal according to claim 1, wherein when the reception means accepts the selection of the icon, the display control means causes the display means to display the function selection screen. The terminal according to claim 1 or 2, wherein the sound data is transmitted to and received from the other terminal. The first communication method includes a first video coding method defined by H.264 / SVC, and the second communication method is a second video coding method defined by H.264 / AVC. The terminal according to any one of claims 1 to 3, wherein the terminal includes a coding method. Further, it has a transmission means for transmitting an operating state indicating that the second communication function is being activated.
When the first communication function is activated by the activation means, the transmission means transmits the video data encoded by the first video coding method via the relay device to the other transmission means. When the second communication function is activated by the activation means, the video data encoded by the second video coding method is directly transmitted to the other terminal. The terminal according to claim 4, wherein the terminal is characterized by the above. One of claims 1 to 5, wherein both the first communication function and the second communication function establish a session for transmitting and receiving the video data by using the same call control method. The terminal described in the section. The first communication function is realized by the first communication application possessed by the terminal, and the second communication function is realized by a second communication application different from the first communication application possessed by the terminal. The terminal according to any one of claims 1 to 6, wherein the terminal is characterized by. The terminal according to any one of claims 1 to 7, wherein the terminal is a video conference terminal. The terminal according to any one of claims 1 to 8, wherein the communication function includes a call function. The terminal according to any one of claims 1 to 9, wherein the information of the other terminal is a destination name associated with the other terminal. The first communication function for communicating video data with another terminal by the first communication method , and the first communication method and at least the video data coding method having the same call control method as the first communication function. Is a communication function activation method executed by a terminal capable of activating a second communication function for communicating video data with another terminal by a second communication method different from the above.
After logging in to the management system that manages the information of other terminals including online, the receiving step of receiving the information of the other terminal from the management system, and
A display control step for displaying information on the other terminal on the display means,
Before starting the communication with the other terminal by the video data, the first icon and the second communication function for activating the first communication function displayed on the display means by the display control step are displayed. A reception step that accepts the selection of either the first icon or the second icon on the function selection screen including the second icon for activation, and
When the selection of the first icon is accepted, the first communication function is activated, and when the selection of the second icon is accepted, the second communication function is activated. ,
Regardless of which of the first communication function and the second communication function activated by the activation step starts communication, the first communication function or the first communication function selected on the function selection screen. With the communication start step of starting the communication by the video data with the other terminal by transmitting the communication start request using the communication session established with the management system in the state where the second communication function is activated by the activation step. A communication function activation method characterized by executing a process including ,. The first communication function for communicating video data with another terminal by the first communication method , and the first communication method and at least the video data coding method having the same call control method as the first communication function. With at least one terminal capable of activating a second communication function for communicating video data with another terminal by a second communication method different from each other.
A management system that manages information on other terminals, including online,
Is a communication system connected via a network
The terminal is
A receiving means for receiving information on the other terminal from the management system after logging in to the management system that manages information on other terminals including online.
A display control means for displaying the information of the other terminal on the display means, and
Before starting the communication by the video data with the other terminal, the first icon and the second communication function for activating the first communication function displayed on the display means by the display control means are displayed. A reception means that accepts the selection of either the first icon or the second icon on the function selection screen including the second icon for activation.
When the selection of the first icon is accepted, the first communication function is activated, and when the selection of the second icon is accepted, the second communication function is activated. ,
Have,
Regardless of whether communication is started by any of the first communication function and the second communication function activated by the activation means, the first communication function or the first communication function selected on the function selection screen. It is characterized in that it starts communication by video data with the other terminal by transmitting a communication start request using a communication session established with the management system in a state where the second communication function is activated by the activation means. Communication system. On the computer
The process of receiving information from the other terminal from the management system after logging in to the management system that manages the information of other terminals including online.
The process of displaying the information of the other terminal on the display means,
Before starting the communication with the other terminal by the video data, the first communication function for communicating the video data with the other terminal is activated by the first communication method displayed on the display means by the display processing. The video data is transferred to another terminal by the first icon for the purpose and the second communication method having the same call control method as the first communication function but different from the first communication method and at least the coding method of the video data. In the function selection screen including the second icon for activating the second communication function for communicating with the first icon, the process of accepting the selection of either the first icon or the second icon.
When the selection of the first icon is accepted, the first communication function is activated, and when the selection of the second icon is accepted, the second communication function is activated.
Regardless of whether communication is started by any of the first communication function and the second communication function activated by the activation process, the first communication function or the first communication function selected on the function selection screen. A process of starting communication by video data with the other terminal by transmitting a communication start request using a communication session established with the management system while the second communication function is activated.
A program characterized by executing.

Images