JP2021083099A - Speech terminal and speech function activation method, and program - Google Patents

Abstract

To solve a problem in two kinds of conventional communication systems of a PDC system and a PHS, that since a call control method for connecting or disconnecting to and from a destination to talk to and a coding method for coding speech data are both different, a conventional talking terminal only has two kinds of speech functions using entirely different communication methods incorporated in a single body and, therefore, cannot use a plurality of kinds of speech functions using a communication system having the same call control method but different coding methods separately for their respective purposes.SOLUTION: A speech terminal exhibits an effect that a plurality of kinds of speech functions using a communication system having the same call control method but different coding methods (e.g., an exclusive terminal function and a non-exclusive terminal function) can be used separately for their respective purposes.SELECTED DRAWING: Figure 18

Description

The present invention relates to an invention that activates one of a plurality of call functions of different call methods.

In recent years, in response to a request to reduce business trip expenses and business trip time, a telephone system for conducting a video conference or the like via a communication network such as the Internet has become widespread. By using such a call system, image data and voice data can be transmitted and received between a plurality of call terminals, and a video conference can be held (see Patent Document 1).

On the other hand, one call terminal is equipped with two types of call functions that use two different types of communication methods, such as PDC (Personal Digital Cellular) method and PHS (Personal Handyphone System), and these two types of communication methods can be used. A videophone system that makes a call by switching has been proposed (see Patent Document 2).

However, the two conventional communication methods differ in both the call control method for connecting or disconnecting the call destination and the coding method for encoding the call data. That is, in the conventional call terminal, two types of call functions using completely different communication methods are mounted in one housing, and only one function is operated exclusively. Therefore, there is a problem that it is not possible to properly use a plurality of types of call functions using communication methods having the same call control method but different coding methods.

The invention according to claim 1 utilizes a predetermined call control method for connecting or disconnecting a call destination and a predetermined display means, and a predetermined coding method for converting call data into an IP packet. Select the first icon for accepting the selection of the first call function for making a call, and the selection of the second call function having the same call control method but different coding method from the first call function. When the display control means for displaying the function selection screen indicating the second icon for acceptance, the reception means for accepting the selection of the first icon or the second icon, and the selection of the first icon are accepted. Is a call terminal characterized by having an activation means for activating the first call function or activating the second call function when the selection of the second icon is accepted. ..

As described above, according to the present invention, there is an effect that a plurality of types of call functions using communication methods having the same call control method but different coding methods can be used properly.

It is the schematic of the call system which concerns on one Embodiment of this invention. It is a conceptual diagram which shows the communication state in the case of realizing a call between the call terminals having a dedicated terminal function. It is a conceptual diagram which shows the image quality of the image data transmitted and received by the standard of SVC in FIG. It is a conceptual diagram which showed the communication state in the case of realizing a call between the call terminals having a non-dedicated terminal function. FIG. 5 is a conceptual diagram showing the image quality of image data transmitted and received according to the AVC standard in FIG. It is an external view of the call terminal which concerns on this embodiment. It is a hardware block diagram of the call terminal which concerns on this embodiment. It is a hardware block diagram of the call management system, the relay device, the program providing system, or the maintenance system which concerns on this Embodiment. It is a functional block diagram of a call terminal, a relay device, and a call management system that form a part of the call system of the embodiment. It is a conceptual diagram which shows the visual information management table. It is a conceptual diagram which shows the relay device management table. It is a conceptual diagram which shows the terminal authentication management table. It is a conceptual diagram which shows the terminal state management table. It is a conceptual diagram which shows the destination list management table. It is a conceptual diagram which shows the session management table. It is a sequence diagram which shows the process of the preparatory stage to start a call between terminals. It is a flowchart which showed the process of selecting a dedicated terminal function or a non-dedicated terminal function. It is a conceptual diagram which shows the call function selection screen. It is a flowchart which showed the process of displaying a destination list. It is a conceptual diagram which shows the destination list. It is a conceptual diagram which shows another example of a function selection screen. It is a conceptual diagram which shows another example of a destination list.

Hereinafter, an embodiment of the present invention will be described with reference to FIGS. 1 to 20.

<< Overall configuration of the embodiment >>
FIG. 1 is a schematic view of a communication system according to an embodiment of the present invention. As shown in FIG. 1, the calling system 1 includes a plurality of calling terminals (10aa, 10ab, ...), a display (120aa, 120ab, ...) For each calling terminal (10aa, 10ab, ...), And a plurality of. It is constructed by a relay device (30a, 30b, 30c), a call management system 50, a program providing system 90, and a maintenance system 100. By communicating image data and sound data as an example of call data by the call system 1, it is possible to realize a video conference between remote locations. The plurality of routers (70a, 70b, 70c, 70d, 70ab, 70cd) select the optimum route of the call data.

Further, the telephone terminal (10aa, 10ab, 10ac, ...), The relay device 30a, and the router 70a are communicably connected by LAN2a. The telephone terminal (10ba, 10bb, 10bc, ...), The relay device 30b, and the router 70b are communicably connected by LAN2b. Further, LAN2a and LAN2b are communicably connected by a dedicated line 2ab including a router 70ab. Further, the LAN 2a, the LAN 2b, and the leased line 2ab are constructed in the predetermined area X. For example, region X is Japan, LAN2a is built in the office in Tokyo, and LAN2b is built in the office in Osaka.

On the other hand, the telephone terminal (10ca, 10cc, 10cc, ...), The relay device 30c, and the router 70c are communicably connected by LAN2c. The call terminal 10d (10da, 10db, 10dc, ...), The relay device 30d, and the router 70d are communicably connected by LAN2d. Further, LAN2c and LAN2d are communicably connected by a dedicated line 2cd including a router 70cd. Further, the LAN 2c, the LAN 2d, and the leased line 2cd are constructed in the predetermined area Y. For example, region Y is the United States, LAN2c is built within a New York office, and LAN2d is Washington D.C. C. It is built in the office of. Area X and area Y are connected to each other from routers (70ab, 70cd) so as to be able to communicate with each other via the Internet 2i.

In the following, the "call terminal" is simply represented as a "terminal", and the "call management system" is simply represented as a "management system". Further, any terminal among the plurality of terminals (10aa, 10ab, ...) Is represented as "terminal 10", and any display among the plurality of displays (120aa, 120ab, ...) Is represented as "display 120". , Any relay device among the plurality of relay devices (30a, 30b, 30c) is represented as "relay device 30". Further, the terminal as the request source for requesting the start of the video conference is represented as the "request source terminal", and the terminal as the destination (relay destination) which is the request destination is represented as the "destination terminal". Further, any router among the routers (70a, 70b, 70c, 70d, 70ab, 70cd) is represented as "router 70".

Further, the management system 50, the program providing system 90, and the maintenance system 100 are connected to the Internet 2i. The management system 50, the program providing system 90, and the maintenance system 100 may be installed in the area X or the area Y, or may be installed in an area other than these.

Further, in the present embodiment, the communication network 2 of the present embodiment is constructed by the LAN2a, LAN2b, the leased line 2ab, the Internet 2i, the leased line 2cd, the LAN2c, and the LAN2d. The communication network 2 may have a place where wireless communication such as WiFi (Wireless Fidelity) or Bluetooth (registered trademark) is performed as well as wired communication.

Further, in FIG. 1, four sets of numbers shown under each terminal 10, each relay device 30, management system 50, each router 70, program providing system 90, and maintenance system 100 are in general IPv4. The IP address is simply shown. For example, the IP address of the terminal 10aa is "1.2.1.3". Further, IPv6 may be used instead of IPv4, but for the sake of simplification of the description, IPv4 is used for the explanation.

It should be noted that each terminal 10 can be used not only for calls between a plurality of business establishments and between different rooms in the same business establishment, but also for calls within the same room, outdoors and indoors, or outdoors and outdoors. May be used. When each terminal 10 is used outdoors, wireless communication such as a mobile phone communication network is performed.

Further, each terminal 10 shown in FIG. 1 is a terminal that realizes a user's call by transmitting and receiving call data, and is, for example, a video conferencing terminal. Further, the terminal 10 transmits and receives call data by using a predetermined communication method (a call control method for connecting or disconnecting a call destination and a coding method for converting call data into an IP packet). Do.

The call control method includes (1) SIP (Session Initiation Protocol), (2) H.323, (3) SIP extension protocol, (4) instant messenger protocol, and (5) SIP MESSAGE method. (6) Internet Relay Chat protocol (IRC), (7) Instant Messenger protocol extended protocol, etc. Of these, (4) instant messenger protocols are, for example, (4-1) XMPP (Extensible Messaging and Presence Protocol), or (4-2) ICQ (registered trademark), AIM (registered trademark), or Skype (registered). It is a protocol used in (trademark) and the like. (7) A protocol that extends the instant messenger protocol is, for example, Jingle.

Further, among the plurality of terminals 10, for example, a communication method in which the call control method is an instant messenger protocol (or a protocol extended from the instant messenger protocol) and the coding method is SVC (Scalable Video Coding) is used. The terminal 10 to be used is represented as a “dedicated terminal”. Further, among the plurality of terminals 10, the terminal 10 that uses a communication method in which the call control method and the coding method are different from those of the dedicated terminal is represented as a “non-dedicated terminal”. Further, in the present embodiment, as an example of two terminals having different communication methods, the "dedicated terminal" is described as a terminal manufactured, sold, or managed by a specific company, and the "non-dedicated terminal" is described above. Described as a terminal manufactured, sold or managed by a company other than the above. In the present embodiment, terminals manufactured, sold, or managed by different companies in this way often have different communication methods, and thus will be described with reference to the above example. As an example of two terminals with different communication methods, among terminals manufactured or sold by the same company, terminals with a newer manufacturing time or selling time are referred to as "dedicated terminals", and terminals with an older manufacturing time or selling time are referred to as "dedicated terminals". It may be a "non-dedicated terminal". Further, the dual codec compatible terminal having the dedicated terminal function and the non-dedicated terminal function communicates with the other party terminal by activating either the dedicated terminal function or the non-dedicated terminal function. That is, by activating the dedicated terminal function, communication can be performed by the same coding method as that of the dedicated terminal. By activating the non-dedicated terminal function, it is possible to communicate using the same coding method as the non-dedicated terminal.

Further, each relay device 30 is a computer system that relays call data between a plurality of terminals 10. The management system 50 is a computer system that centrally manages login authentication from the terminal 10, management of the operating state and call status of the terminal 10, management of the destination list, and the communication status of the relay device 30. The image of the image data may be a moving image or a still image, and may be both a moving image and a still image.

The program providing system 90 is a computer system that provides the programs used in each of the terminal 10, the relay device 30, the management system 50, and the maintenance system 100 to the terminal 10, the relay device 30, the management system 50, and the maintenance system 100 via the communication network 2.

The maintenance system 100 is a computer system for maintaining, managing, or maintaining at least one of the terminal 10, the relay device 30, the management system 50, and the program providing system 90. For example, when the maintenance system 100 is installed in Japan and the terminal 10, the relay device 30, the management system 50, or the program providing system 90 is installed overseas, the maintenance system 100 is remotely installed via the communication network 2. , Terminal 10, relay device 30, management system 50, and maintenance of at least one of the program providing system 90, such as maintenance, management, and maintenance. Further, the maintenance system 100 includes a model number, a serial number, a sales destination, a maintenance inspection, and a model number, a serial number, a sales destination, and a maintenance inspection in at least one of the terminal 10, the relay device 30, the management system 50, and the program providing system 90 without going through the communication network 2. Alternatively, perform maintenance such as managing failure history.

Subsequently, with reference to FIGS. 2 and 3, a first communication pattern for realizing a call between the two terminals 10 will be described. Note that FIG. 2 is a conceptual diagram showing a communication status when a call is realized between call terminals having a dedicated terminal function. Further, the terminal 10 includes a dedicated terminal, a non-dedicated terminal, and a dual codec compatible terminal having a dedicated terminal function (an example of a first call function) and a non-dedicated terminal function (an example of a second call function). include. Here, the non-dedicated terminal refers to a terminal whose call control method and coding method are different from those of the dedicated terminal as described above. Further, the non-dedicated terminal function refers to a terminal function having the same call control method as the dedicated terminal function but different coding methods.

Of these, the dedicated terminal and the terminal on which the dedicated terminal function is activated are exclusively used in the call system 1 that executes the first communication pattern, as shown in FIG. FIG. 2 shows a case where the request source terminal is a dual codec compatible terminal 10, the dedicated terminal function is activated, and the destination terminal is a dedicated terminal.

This call system 1 uses, for example, a communication method in which the call control method is an instant messenger protocol (or a protocol extended from the instant messenger protocol) and the coding method is H.264 / SVC (Scalable Video Coding). Then, the call data is communicated. Specifically, as shown in FIG. 2, in the call system 1, the request source terminal and the destination terminal are for management to send and receive various management information via the management system 50. Communication session sei is established. The communication session sei is also a communication session for call control.

On the other hand, between the requesting terminal and the relay device 30 in which the dedicated terminal function is activated, high-resolution image data, medium-resolution image data, low-resolution image data, and audio data are used according to the SVC coding method. A first communication session sed1 for a call to send and receive one call data has been established. Further, the relay device 30 and the destination terminal similarly transmit and receive four call data of high resolution image data, medium resolution image data, low resolution image data, and voice data by the SVC coding method. A second communication session sed2 has been established for the call.

Here, with reference to FIG. 3, the image resolution of the image data handled in the first communication pattern shown in FIG. 2 will be described. Note that FIG. 3 is a conceptual diagram showing the image quality of image data transmitted and received according to the SVC standard in FIG.

As shown in FIG. 3A, a low-resolution image consisting of 160 pixels in the horizontal direction and 120 pixels in the vertical direction and serving as a base image, and as shown in FIG. 3B, the horizontal direction is Data of a medium-resolution image having 320 pixels and 240 pixels in the vertical direction and a high-resolution image having 640 pixels in the horizontal direction and 480 pixels in the vertical direction are transmitted and received as shown in FIG. 3C. Of these, when passing through a narrow band path, low-quality image data consisting of only low-resolution image data serving as a base image is relayed by the relay device 30. When the band is relatively wide, the relay device 30 relays the low-resolution image data as the base image and the medium-quality image data including the medium-resolution image data. When the band is very wide, the relay device 30 relays high-quality image data including low-resolution image data, medium-resolution image data, and high-resolution image data, which are the base image quality. ..

Subsequently, with reference to FIGS. 4 and 5, a second communication pattern for realizing a call between the two terminals 10 will be described. It is a conceptual diagram which shows the communication state in the case of realizing a call between the call terminals having a non-dedicated terminal function.

As shown in FIG. 4, the non-dedicated terminal and the terminal in which the non-dedicated terminal function is activated are exclusively used in the call system 1'that executes the second communication pattern, and are shown in FIG. As described above, the call system 1 that executes the first communication pattern cannot be used because the communication method is different from that of the dedicated terminal and the dedicated terminal function. Note that FIG. 4 shows a case where the requesting terminal is a dual codec compatible terminal, the non-dedicated terminal function is activated, and the destination terminal is a non-dedicated terminal.

In this call system 1', the call control method of the requesting terminal is the same instant messenger protocol as the first communication pattern (or a protocol extended from the instant messenger protocol), and the coding method is the first communication pattern. Unlike H.264 / AVC (Advanced Video Coding), the communication method is used to communicate call data. Specifically, as shown in FIG. 4, in the call system 1', a management communication session sei1 for transmitting and receiving various management information is established between the requesting terminal and the management system 50. Has been done. The communication session sei1 is also a communication session for call control. Further, when the non-dedicated terminal function is activated in the requesting terminal, the coding method is changed from SVC to AVC.

On the other hand, a communication session sei2 for call control of a non-dedicated terminal has been established between the management system 50 and the destination terminal, and this call control method is different from that of the requesting terminal. For example, SIP (Session Initiation Protocol) or H.323. In this case, since the call control method differs between the request source terminal and the destination terminal, the management system 50 converts the call control method. Specifically, when the requesting terminal is activating the non-dedicated terminal function, the data related to call control is converted based on the conversion rule data used by the management system 50 to convert the call control method. Then call control is performed. Further, the coding method of the destination terminal (non-dedicated terminal) is the same AVC as the requesting terminal in which the non-dedicated terminal function is activated.

Further, a communication session sed for a call for transmitting and receiving call data is established between the request source terminal and the destination terminal. The communication session sed may be established directly between the requesting terminal and the destination terminal, or may be established via a relay device.

Here, the image resolution of the image data handled in the second communication pattern shown in FIG. 4 will be described with reference to FIG. Note that FIG. 5 is a conceptual diagram showing the image quality of image data transmitted and received according to the AVC standard in FIG. As shown in FIG. 5, only one image data having 320 pixels in the horizontal direction and 240 pixels in the vertical direction is transmitted and received.

<< Hardware configuration of the embodiment >>
Next, the hardware configuration of this embodiment will be described. FIG. 6 is an external view of a telephone terminal according to the present embodiment. As shown in FIG. 6, the terminal 10 includes a housing 1100, an arm 1200, and a camera housing 1300. Of these, the front side wall surface 1110 of the housing 1100 is provided with an intake surface (not shown) formed by a plurality of intake holes, and the rear side wall surface 1120 of the housing 1100 is provided with a plurality of exhaust holes. The exhaust surface 1121 is provided. As a result, by driving the cooling fan built in the housing 1100, the outside air behind the terminal 10 can be taken in through the intake surface (not shown) and exhausted to the rear of the terminal 10 through the exhaust surface 1121. A sound collecting hole 1131 is formed in the right side wall surface 1130 of the housing 1100, and sounds such as voice, noise, and noise can be picked up by a built-in microphone 114 described later.

An operation panel 1150 is formed on the right side wall surface 1130 side of the housing 1100. The operation panel 1150 is provided with a plurality of operation buttons (108a to 108e) described later, a power switch 109 described later, and an alarm lamp 119 described later, and outputs sound from the built-in speaker 115 described later. A sound output surface 1151 formed by a plurality of audio output holes for passing through is formed. Further, on the left side wall surface 1140 side of the housing 1100, an accommodating portion 1160 is formed as a recess for accommodating the arm 1200 and the camera housing 1300. The right side wall surface 1130 of the housing 1100 is provided with a plurality of connection ports (1132a to 1132c) for electrically connecting a cable to the external device connection I / F 118 described later. On the other hand, the left side wall surface 1140 of the housing 1100 is provided with a connection port (not shown) for electrically connecting the cable 120c for the display 120 to the external device connection I / F 118 described later.

In the following, "operation button 108" is used to indicate an arbitrary operation button among the operation buttons (108a to 108e), and "operation button 108" is used to indicate an arbitrary connection port among the connection ports (1132a to 1132c). This will be described with reference to the connection port 1132.

Next, the arm 1200 is attached to the housing 1100 via the torque hinge 1210, and the arm 1200 is configured to be rotatable in the vertical direction within a range of a tilt angle θ1 of 135 degrees with respect to the housing 1100. ing. FIG. 6 shows a state in which the tilt angle θ1 is 90 degrees. The camera housing 1300 is provided with a built-in camera 112, which will be described later, and can image users, documents, rooms, and the like. Further, a torque hinge 1310 is formed in the camera housing 1300. The camera housing 1300 is attached to the arm 1200 via a torque hinge 1310. The camera housing 1300 is attached to the arm 1200 via the torque hinge 1310, and the pan angle θ2 of ± 180 degrees with respect to the arm 1200 with the state shown in FIG. 6 as 0 degree. It is configured to be rotatable in the vertical and horizontal directions within the range of ± 45 degrees and the tilt angle θ3.

Since the relay device 30, the management system 50, the program providing system 90, and the maintenance system 100 each have the same appearance as a general server / computer, the description of the appearance will be omitted.

FIG. 7 is a hardware configuration diagram of the terminal according to the present embodiment. As shown in FIG. 7, the terminal 10 of the present embodiment includes a program used to drive the CPU 101 such as a CPU (Central Processing Unit) 101 and an IPL (Initial Program Loader) that control the operation of the entire terminal 10. The stored ROM (Read Only Memory) 102, the RAM (Random Access Memory) 103 used as the work area of the CPU 101, the flash memory 104 for storing various data such as programs for the terminal 10, image data, and audio data, and the CPU 101. SSD (Solid State Drive) 105 that controls reading or writing of various data to the flash memory 104 according to the control of the flash memory, media drive 107 that controls reading or writing (storage) of data to the recording medium 106 such as the flash memory, terminal 10. Operation button 108 operated when selecting a destination, a power switch 109 for switching the power ON / OFF of the terminal 10, and a network I / F (Interface) for data transmission using the communication network 2. ) 111 is provided.

Further, the terminal 10 has a built-in camera 112 that captures a subject and obtains image data under the control of the CPU 101, an image pickup element I / F 113 that controls the drive of the camera 112, a built-in microphone 114 that inputs voice, and voice. The image data is transferred to the external display 120 under the control of the built-in speaker 115, the audio input / output I / F 116 that processes the input / output of the audio signal between the microphone 114 and the speaker 115 under the control of the CPU 101, and the CPU 101. The display I / F 117 to be transmitted, the external device connection I / F 118 for connecting various external devices, the alarm lamp 119 notifying the abnormality of various functions of the terminal 10, and each of the above components are as shown in FIG. It is provided with a bus line 110 such as an address bus or a data bus for electrically connecting to the speaker.

The display 120 is a display unit composed of a liquid crystal or an organic EL for displaying an image of a subject, an operation, and the like. Further, the display 120 is connected to the display I / F 117 by the cable 120c. The cable 120c may be a cable for analog RGB (VGA) signals, a cable for component video, or for HDMI (High-Definition Multimedia Interface) or DVI (Digital Video Interactive) signals. Cable may be. HDMI is a registered trademark.

The camera 112 includes a lens and a solid-state image sensor that converts light into electric charges to digitize an image (video) of the subject. As the solid-state image sensor, CMOS (Complementary Metal Oxide Semiconductor) or CCD (Charge Coupled Device) Etc. are used.

The external device connection I / F 118 is connected to an external camera, an external microphone, an external speaker, etc. by a USB (Universal Serial Bus) cable or the like inserted into the connection port 1132 of the housing 1100 shown in FIG. External devices can be electrically connected to each other. When an external camera is connected, the external camera is driven in preference to the built-in camera 112 according to the control of the CPU 101. Similarly, when an external microphone is connected or an external speaker is connected, the external microphone and the external speaker are given priority over the built-in microphone 114 and the built-in speaker 115 according to the control of the CPU 101. The external speaker is driven.

The recording medium 106 has a structure that allows it to be attached to and detached from the terminal 10. Further, as long as it is a non-volatile memory that reads or writes data under the control of the CPU 101, not only the flash memory 104 but also an EEPROM (Electrically Erasable and Programmable ROM) or the like may be used.

FIG. 8 is a hardware configuration diagram of the management system according to the present embodiment of the present invention. The management system 50 includes a CPU 201 that controls the operation of the entire management system 50, a ROM 202 that stores programs used to drive the CPU 201 such as an IPL, a RAM 203 that is used as a work area of the CPU 201, and various programs for the management system 50. Media that controls reading or writing (storage) of data to recording media 206 such as HDD (Hard Disk Drive) 205 and flash memory that control reading or writing of various data to HD204 according to the control of HD204 and CPU201 that store data. Drive 207, display 208 for displaying various information such as cursors, menus, windows, characters, or images, network I / F 209 for data communication using communication network 2, input of characters, numerical values, various instructions, etc. Keyboard 211 with multiple keys for, mouse 212 for selecting and executing various instructions, selecting processing targets, moving the cursor, etc., CD-ROM (Compact Disc Read Only Memory) as an example of a removable recording medium ) CD-ROM drive 214 that controls reading or writing of various data to 213, and a bus line such as an address bus or data bus for electrically connecting each of the above components as shown in FIG. It is equipped with 210.

On the other hand, since the relay device 30, the program providing system 90, and the maintenance system 100 have the same hardware configuration as the management system 50, the description thereof will be omitted. However, each HD 204 stores various data such as a program for controlling the relay device 30, the program providing system 90, and the maintenance system 100, respectively.

The programs for the terminal 10, the relay device 30, the program providing system 90, and the maintenance system 100 are computer-readable recording media (recording media 106, etc.) in an installable format or an executable format file. It may be recorded in and distributed. Further, as another example of the recording medium, a CD-R (Compact Disc Recordable), a DVD (Digital Versatile Disk), a Blu-ray disc, and the like can be mentioned.

<< Functional configuration of the embodiment >>
Next, the functional configuration of this embodiment will be described. FIG. 9 is a functional block diagram of a terminal 10, a relay device 30, and a management system 50 that form a part of the communication system 1 of the present embodiment. In FIG. 9, the terminal 10, the relay device 30, and the management system 50 are connected so that data communication can be performed via the communication network 2.

<Terminal function configuration>
The terminal 10 includes a transmission / reception unit 11, an operation input reception unit 12, a login request unit 13, an imaging unit 14, a voice input unit 15a, a voice output unit 15b, a display control unit 16, an activation unit 17, a destination list creation unit 18, and a storage unit. -Has a read processing unit 19. Each of these parts has a function realized by operating any of the components shown in FIG. 7 by an instruction from the CPU 101 according to a program for the terminal 10 expanded on the RAM 103 from the flash memory 104. Or a means.

Further, the terminal 10 has a storage unit 1000 constructed by the RAM 103 shown in FIG. 7 and the flash memory 104 shown in FIG. In the storage unit 1000, a visual information management DB (Data Base) 1001 composed of a visual information management table described later is constructed. Further, the storage unit 1000 stores a dedicated terminal application for realizing the dedicated terminal function in the terminal 10 and a non-dedicated terminal application for realizing the non-dedicated terminal function in the terminal 10.

(Visual information management table)
FIG. 10 is a conceptual diagram showing a visual information management table. In the visual information management table, the visual information represented by the destination list displayed on the display 120 is associated and managed for each operating state information indicating the operating state of the destination terminal. Each visual information is, for example, each icon in the form shown in FIG. Each visual information constituting the visual information management table may be sent from the management system 50 when the requesting terminal requests login in step S22 described later, or may be sent from the storage unit 1000 before the requesting terminal is shipped from the factory. It may be stored in.

The visual information of the present embodiment is the first visual information that visually indicates that the communication method used by the destination terminal is the communication method used by the requesting terminal (dedicated terminal), and the destination terminal. It visually indicates that the communication method used is not the communication method used by the requesting terminal (dedicated terminal), and is classified into the second visual information visually different from the first visual information. Among these, the first visual information includes visual information such as icons indicating that the operating state is online (callable), online (during a call), online (temporarily suspended), or offline.

Further, in the second visual information, when communication is performed between the terminals 10 having the two functions of the dedicated terminal function and the non-dedicated terminal function, the requesting terminal activates the dedicated terminal function and the destination terminal. Indicates an icon or the like displayed on the display 120 on the requesting terminal side when the non-dedicated terminal function is activated.

(Each function configuration of the terminal)
Next, each functional configuration of the terminal 10 will be described in detail with reference to FIGS. 7 and 9. In the following description of each functional configuration of the terminal 10, the relationship with the main components for realizing each functional configuration of the terminal 10 among the constituent elements shown in FIG. 7 will also be described. ..

The transmission / reception unit 11 of the terminal 10 shown in FIG. 9 is realized by the command from the CPU 101 shown in FIG. 7 and the network I / F 111 shown in FIG. Sends and receives various data (or information) to and from the terminal, device or system of. The transmission / reception unit 11 starts receiving state information indicating the state of each terminal as a destination candidate from the management system 50 even before starting a call with a desired destination terminal. It should be noted that this status information includes not only the operating status of each terminal 10 (whether online or offline), but also whether it is possible to make a call even online, whether the call is in progress, whether the user is away from the desk, and the like. Shows the detailed state of. Further, this state information is not only the operating state of each terminal 10, but also the cable 120c is disconnected from the terminal 10 at the terminal 10, the sound is output but the image is not output, or the sound is not output. Indicates various states such as (MUTE). In addition, the state information includes the state in which the non-dedicated terminal function is being activated as described above. In the following, as an example, a case where the state information indicates an operating state will be described.

The operation input receiving unit 12 is realized by the command from the CPU 101 shown in FIG. 7 and the operation button 108 and the power switch 109 shown in FIG. 7, and receives various inputs by the user. For example, when the user turns on the power switch 109 shown in FIG. 7, the operation input receiving unit 12 shown in FIG. 9 accepts the power on and turns on the power.

The login request unit 13 is realized by a command from the CPU 101 shown in FIG. 7, and upon receiving the power-on, the transmission / reception unit 11 requests the management system 50 to log in via the communication network 2. The login request information indicating the above and the current IP address of the requesting terminal are automatically transmitted. Further, when the user turns off the power switch 109 from the ON state, the operation input reception unit 12 completely turns off the power after the transmission / reception unit 11 transmits the state information to the management system 50 to turn off the power. To do. As a result, on the management system 50 side, it is possible to grasp that the terminal 10 has been turned from the power on to the power off.

The image pickup unit 14 is realized by the command from the CPU 101 shown in FIG. 7 and the camera 112 and the image pickup element I / F 113 shown in FIG. 7, and images the subject, and the image obtained by the image pickup. Output data.

The voice input unit 15a is realized by the command from the CPU 101 shown in FIG. 7 and the voice input / output I / F 116 shown in FIG. 7, and the user's voice is converted into a voice signal by the microphone 114. After that, the voice data related to this voice signal is input. The voice output unit 15b is realized by the command from the CPU 101 shown in FIG. 7 and the voice input / output I / F 116 shown in FIG. 7, outputs the voice signal related to the voice data to the speaker, and outputs the voice signal to the speaker 115. Output audio from.

The display control unit 16 is realized by the command from the CPU 101 shown in FIG. 7 and the display I / F 117 shown in FIG. 7, and as described later, combines received image data having different resolutions. Control is performed to transmit this combined image data to the display 120. Further, the display control unit 16 can transmit the destination list information received from the management system 50 to the display 120 to display the destination list on the display 120.

Further, the display control unit 16 extracts the corresponding visual information by searching the visual information management table (see FIG. 10) using the operating state information received from the management system 50 by the transmission / reception unit 11 as a search key, and self-extracts the corresponding visual information. It is included in the destination list and displayed on the display 120 of the terminal 10.

The activation unit 17 determines whether or not the transmission / reception unit 11 has received a call start request from another dedicated terminal (or another terminal for which the dedicated terminal function has been activated). Further, the activation unit 17 activates either the dedicated terminal function or the non-dedicated terminal function. Further, the activation unit 17 stops the activated dedicated terminal function or non-dedicated terminal function.

The destination list creation unit 18 displays the status of the destination candidate as shown in FIG. 20 as an icon based on the destination list information described later and the status information of the terminal 10 as each destination candidate received from the management system 50. Create and update the indicated destination list.

The storage / reading processing unit 19 is executed by the instruction from the CPU 101 shown in FIG. 7 and the SSD 105 shown in FIG. 7, or is realized by the instruction from the CPU 101, and various data is stored or stored in the storage unit 1000. A process of reading various data stored in the unit 1000 is performed. The storage unit 1000 stores a terminal ID (Identification) for identifying the terminal 10, a password, and the like. Further, the storage unit 1000 overwrites and stores the image data and the voice data received when making a call with the destination terminal each time it is received. Of these, the image is displayed on the display 120 by the image data before being overwritten, and the sound is output from the speaker 115 by the sound data before being overwritten.

The terminal ID of the present embodiment and the relay device ID described later indicate identification information such as a language, characters, symbols, or various marks used for uniquely identifying the terminal 10 and the relay device 30, respectively. Further, the terminal ID and the relay device ID may be identification information in which at least two of the above languages, characters, symbols, and various marks are combined.

<Functional configuration of relay device>
The relay device 30 has a transmission / reception unit 31 and a data quality change unit 32. Each of these parts has a function realized by operating any of the components shown in FIG. 8 by an instruction from the CPU 201 according to a program for the relay device 30 developed on the RAM 203 from the HD 204. It is a means.

(Each function configuration of the relay device)
Next, each functional configuration of the relay device 30 will be described in detail. In the following description of each functional configuration of the relay device 30, among the constituent elements shown in FIG. 8, the relationship with the main constituent elements for realizing each functional configuration of the relay device 30 is also included. explain.

The transmission / reception unit 31 of the relay device 30 shown in FIG. 9 is realized by the command from the CPU 201 shown in FIG. 8 and the network I / F 209 shown in FIG. 8, and is realized via the communication network 2. Sends and receives various data (or information) to and from other terminals, devices, or systems. As a result, the relay device 30 relays the call data between the plurality of terminals 10.

Further, the transmission / reception unit 31 instructs the destination indicated by the IP address of the requesting terminal among the IP addresses received by the transmission / reception unit 31 to start a communication session (first communication session sed1). Send session start instruction information to do. Further, the transmission / reception unit 31 starts a session for instructing the destination indicated by the IP address among the IP addresses received by the transmission / reception unit 31 to start a communication session (second communication session). The instruction information and the IP address of the destination terminal are transmitted.

The data quality changing unit 32 is realized by the instruction from the CPU 201 shown in FIG. 8 and changes the image quality of the image data sent from the source terminal. As a result, even if the reception of the image data on the terminal 10 is delayed due to the mixture of the communication networks 2 or the like, the relay device 30 reduces the image quality of the image data to be relayed, thereby taking measures against the delay. It can be carried out. For example, when the reception of image data is delayed, the relay of high-resolution image data (see FIG. 3C) among the three image quality image data shown in FIG. 3 is interrupted, resulting in a delay. Take measures.

<Functional configuration of management system>
The management system 50 includes a transmission / reception unit 51, a terminal authentication unit 52, a state management unit 53, an extraction unit 54, a determination unit 55, a session management unit 56, a conversion unit 57, and a storage / reading processing unit 59. Each of these parts has a function realized by operating any of the components shown in FIG. 8 by an instruction from the CPU 201 according to a program for the management system 50 developed on the RAM 203 from the HD 204. It is a means. Further, the management system 50 has a storage unit 5000 constructed by the HD 204 shown in FIG. The storage unit 5000 stores frame data of the destination list, which will be described later, and conversion rule data used for converting the call control method.

(Relay device management table)
FIG. 11 is a conceptual diagram showing a relay device management table. In the storage unit 5000, a relay device management DB 5001 configured by a relay device management table as shown in FIG. 11 is constructed. In this relay device management table, for each relay device ID of each relay device 30, the operating status of each relay device 30, the reception date and time when the status information indicating the operating status is received by the management system 50, and the IP address of the relay device 30. , And the maximum data call speed (Mbps) in the relay device 30 are associated and managed. For example, in the relay device management table shown in FIG. 11, the relay device 30a having the relay device ID "111a" is in the "online" operating state, and the date and time when the status information is received by the management system 50 is "2011". At 13:00 on November 10, 2014, it was shown that the IP address of the relay device 30a is "1.2.1.2" and the maximum data call speed of the relay device 30a is 100 Mbps. There is.

(Terminal authentication management table)
FIG. 12 is a conceptual diagram showing a terminal authentication management table. In the storage unit 5000, a terminal authentication management DB 5002 configured by a terminal authentication management table as shown in FIG. 12 is constructed. In this terminal authentication management table, a password for authentication is associated and managed for each terminal ID of all terminals 10 managed by the management system 50. For example, in the terminal authentication management table shown in FIG. 12, it is shown that the terminal ID of the terminal 10aa is "01aa" and the password is "aaaa".

(Terminal state management table)
FIG. 13 is a conceptual diagram showing a terminal state management table. In the storage unit 5000, a terminal state management DB 5003 configured by a terminal state management table as shown in FIG. 13 is constructed. In this terminal state management table, for each terminal ID of each terminal 10, the destination name when each terminal 10 is the destination, the operating state of each terminal 10, and the reception date and time when the login request information described later is received by the management system 50. , And the IP address of the terminal 10 are associated and managed. For example, in the terminal status management table shown in FIG. 13, the terminal 10aa with the terminal ID "01aa" has the terminal name "Japan Tokyo Office AA terminal" and the operating status "online (callable)". , It is shown that the date and time when the login request information was received by the management system 50 is "13:40 on November 10, 2011", and the IP address of this terminal 10aa is "1.2.1.3". Has been done.

However, in the terminal status management table, terminal information including the terminal ID, terminal name, operating status, reception date and time, and IP address of the non-dedicated terminal 10 (that is, the terminal having the dedicated terminal function and the terminal other than the dedicated terminal) is managed. It is not managed because it is out of scope.

(Destination list management table)
FIG. 14 is a conceptual diagram showing a destination list management table. In the storage unit 5000, a destination list management DB 5004 configured by a destination list management table as shown in FIG. 14 is constructed. In this destination list management table, all terminal IDs of destination terminals registered as candidates for destination terminals are managed in association with the terminal ID of the requesting terminal that requests the start of a call. For example, in the destination list management table shown in FIG. 14, a candidate for a destination terminal capable of requesting the start of a call from a requesting terminal (terminal 10aa) having a terminal ID of "01aa" has a terminal ID of "01aa". It is shown that the terminal 10ab of "01ab", the terminal 10ba of the terminal ID "01ba", the terminal 10bb of the terminal ID "01bb", and the like. The candidate of the destination terminal is updated by being added or deleted by a request for addition or deletion to the management system 50 from an arbitrary requesting terminal. In the destination list management table (see FIG. 14) as in the terminal status management table, the terminal IDs of non-dedicated terminals are not managed because they are not managed.

(Session management table)
FIG. 15 is a conceptual diagram showing a session management table. In the storage unit 5000, a session management DB 5005 composed of a session management table as shown in FIG. 15 is constructed. In this session management table, image data is received at the relay device ID of the relay device 30 used for relaying call data (image data and voice data), the terminal ID of the requesting terminal, the terminal ID of the destination terminal, and the destination terminal. The reception delay time (ms) at the time of reception and the reception date and time when the delay time information indicating the delay time is sent from the destination terminal and received by the management system 50 are managed in association with each other.

For example, in the session management table shown in FIG. 15, the relay device 30a (relay device ID "111a") has a requesting terminal (terminal 10aa) having a terminal ID of "01aa" and a terminal ID of "01ca". Image data and audio data are relayed to and from the destination terminal (terminal 10ca), and the delay time of the image data at the destination terminal (terminal 10ca) as of "14:00 on November 10, 2011" It is shown to be 200 (ms). When making a call between the two terminals 10, the reception date and time of the delay time information may be managed based on the delay time information transmitted from the requesting terminal instead of the destination terminal. However, when a call is made between three or more terminals 10, the reception date and time of the delay time information is managed based on the delay time information transmitted from the terminal 10 on the receiving side of the image data and the voice data. ..

(Each functional configuration of the management system)
Next, each functional configuration of the management system 50 will be described in detail. In the following description of each functional configuration of the management system 50, among the constituent elements shown in FIG. 8, the relationship with the main constituent elements for realizing each functional configuration of the management system 50 is also included. explain.

The transmission / reception unit 51 is executed by the instruction from the CPU 201 shown in FIG. 8 and the network I / F 209 shown in FIG. 8, and is executed by the communication network 2 with other terminals, devices or systems, and various data ( Or information) is sent and received.

The terminal authentication unit 52 is realized by the command from the CPU 201 shown in FIG. 8, and uses the terminal ID and password included in the login request information received via the transmission / reception unit 51 as a search key for terminal authentication management. Terminal authentication is performed by searching the table (see FIG. 12) and determining whether the same terminal ID and password are managed in this terminal authentication management table.

The state management unit 53 is realized by the command from the CPU 201 shown in FIG. 8, and in order to manage the operating state of the requesting terminal that has requested the login, the state management unit 53 is displayed in the terminal state management table (see FIG. 13). The terminal ID of the terminal, the operating state of the requesting terminal, the reception date and time when the login request information was received by the management system 50, and the IP address of the requesting terminal are stored and managed in association with each other. Further, the state management unit 53 changes the state of the power switch 109 of the terminal 10 from on to off, and the state management unit 53 determines the terminal state based on the state information sent from the terminal 10 to turn off the power. The operating status indicating online of the management table (see FIG. 13) is changed to offline.

The extraction unit 54 is realized by the instruction from the CPU 201 shown in FIG. 8, searches each management DB constructed in the storage unit 5000 by various search keys, and obtains data (information) corresponding to the search keys. Extract as a search result.

For example, the extraction unit 54 searches the destination list management table (see FIG. 14) using the terminal ID of the requesting terminal that requested the login as a key, and determines the candidate terminal ID of the destination terminal that can talk to the requesting terminal. Extract. Further, the extraction unit 54 searches the terminal status table (see FIG. 13) using the terminal ID of the candidate terminal of the destination terminal as a search key, and extracts the operating status for each terminal ID. As a result, the extraction unit 54 can acquire the operating state of the candidate of the destination terminal that can make a call with the requesting terminal that has requested the login.

Further, the extraction unit 54 searches the destination list management table (see FIG. 14) using the terminal ID of the requesting terminal that has requested login as a key, and registers the terminal ID of the requesting terminal as a candidate for the destination terminal. The terminal IDs of other requesting terminals are also extracted. Further, the extraction unit 54 searches the terminal state management table (see FIG. 13) using the terminal ID as a search key, and also acquires the operating state of the requesting terminal that has requested the login.

Further, the extraction unit 54 extracts the IP address of the corresponding terminal 10 by searching the terminal state management table (see FIG. 13) using the terminal ID of the terminal 10 received by the transmission / reception unit 51 as a search key. Further, the extraction unit 54 extracts the corresponding terminal ID by searching the terminal state management table (see FIG. 13) using the IP address of the destination terminal as a search key.

Subsequently, the determination unit 55 determines whether or not the operating state, which is realized by the instruction from the CPU 201 shown in FIG. 8 and is indicated by the operating state information, is “online”. Further, the determination unit 55 determines that the operating status information can be transmitted to the predetermined terminal 10 when it is determined to be "online", and when it is determined that it is not "online", the predetermined terminal It is determined that the operation status information cannot be transmitted to 10.

The session management unit 56 is realized by the instruction from the CPU 201 shown in FIG. 8, and the relay device ID of the relay device 30 used for relaying the call data is displayed in the session management table (see FIG. 15) of the storage unit 5000. , The terminal ID of the requesting terminal, the terminal ID of the destination terminal, the delay time (ms) of reception when the image data is received at the destination terminal, and the delay time information indicating this delay time are transmitted from the destination terminal. The reception date and time received by the management system 50 is associated and stored and managed. In addition, the session management unit 56 creates a session ID used to establish a communication session.

When the conversion unit 57 indicates in the terminal state management table that the operating state corresponding to the terminal ID of the requesting terminal has activated the non-dedicated terminal function, the conversion unit 57 calls according to the conversion rule data stored in the storage unit 5000 in advance. Control is executed, and the call control method transmitted from the requesting terminal and the call control method transmitted from the destination terminal are mutually converted.

The storage / reading processing unit 59 is executed by the instruction from the CPU 201 shown in FIG. 8 and the HDD 205 shown in FIG. 8, and various data are stored in the storage unit 5000 or stored in the storage unit 5000. Performs the process of reading various data.

<< Processing or operation of the embodiment >>
Subsequently, the case where the terminal 10 having the dedicated terminal function and the non-dedicated terminal function is the requesting terminal will be described with reference to FIGS. 6, 9, and 16 to 20. Note that FIG. 16 is a sequence diagram showing a call start request.

As shown in FIG. 16, first, when the user of the requesting terminal (terminal 10aa) supporting the dual codec turns on the power switch 109 shown in FIG. 6, it is shown in FIG. The operation input receiving unit 12 receives the power on and turns on the power (step S21). Then, the login request unit 13 automatically transmits the login request information indicating the login request from the transmission / reception unit 11 to the management system 50 via the communication network 2 when the power is turned on (step S22). This login request information includes a terminal ID and a password for identifying the terminal 10aa which is the request source terminal. These terminal IDs and passwords are data read from the storage unit 1000 via the storage / reading processing unit 19 and sent to the transmission / reception unit 11. When the login request information is transmitted from the request source terminal (terminal 10aa) to the management system 50, the management system 50 on the receiving side can grasp the IP address of the terminal 10aa on the transmitting side.

Next, the terminal authentication unit 52 of the management system 50 searches the terminal authentication management table (see FIG. 12) using the terminal ID and password included in the login request information received via the transmission / reception unit 51 as search keys. , Terminal authentication is performed by determining whether the same terminal ID and the same password are managed in this terminal authentication management table (step S23). Since the same terminal ID and the same password are managed by the terminal authentication unit 52, if it is determined that the login request is from the terminal 10 having a legitimate usage authority, the state management unit 53 will perform the status management unit 53. In the terminal status management table (see FIG. 13), the operating status, the date and time when the login request information was received, and the IP address of the terminal 10aa are stored in association with each record indicated by the terminal ID and destination name of the terminal 10aa. (Step S24). As a result, in the terminal status management table, the terminal ID "01aa", the destination name, the operating status "online", the reception date and time "2011.11.10.13: 40", and the terminal IP address "1.2.1. 3 ”will be managed in association with each other.

Then, the transmission / reception unit 51 of the management system 50 requests the login of the authentication result information indicating the authentication result obtained by the terminal authentication unit 52 via the communication network 2 (terminal 10aa). (Step S25). In the present embodiment, the case where the terminal authentication unit 52 determines that the terminal has a legitimate usage authority will be continuously described below.

The extraction unit 54 of the management system 50 searches the destination list management table (see FIG. 14) based on the terminal ID "01aa" of the requesting terminal (terminal 10aa) that has made a login request, thereby causing the requesting terminal (terminal). The terminal ID of another requesting terminal that has registered the terminal ID "01aa" of 10aa) as a candidate for the destination terminal is extracted (step S26). Here, for the sake of simplification of the description, the case where the terminal ID extracted in step S26 is the terminal ID “01ba” of the terminal 10ba will be continuously described below.

Next, the extraction unit 54 of the management system 50 searches the terminal state management table (see FIG. 13) using the terminal ID "01aa" of the requesting terminal (terminal 10aa) that has made the login request as a search key. The operating state of the requesting terminal (terminal 10aa) that has requested login is extracted (step S27).

Next, the transmission / reception unit 51 includes the terminal ID "01aa" of the requesting terminal (terminal 10aa) and the operating state information indicating the operating state of the requesting terminal (terminal 10aa) with respect to the terminal 10ba. "Terminal status information" is transmitted (step S28). As a result, the transmission / reception unit of the terminal 10ca receives the state information of the terminal. Therefore, in the terminal 10ba, a destination list reflecting the latest operating state of the terminal 10aa is created and displayed on the display 120ba, as in the process of step S28 described later.

On the other hand, in the requesting terminal (terminal 10aa), the selection process of either the dedicated terminal function or the non-dedicated terminal function is performed (step S29). Here, the function selection process will be described in more detail with reference to FIG. Note that FIG. 17 is a flowchart showing a process of selecting the dedicated terminal function or the non-dedicated terminal function.

First, the display control unit 16 of the requesting terminal (terminal 10aa) causes the display 120aa to display the function selection screen 900 as shown in FIG. 18 (step S29-1). Note that FIG. 18 is a conceptual diagram showing a call function selection screen. As shown in FIG. 18, on the function selection screen 900, a function selection icon 910 for activating the dedicated terminal function (an example of the first icon) and a function selection for activating the non-dedicated terminal function are displayed. The icon 920 (an example of the second icon) is displayed in parallel. Further, on the lower right side of the function selection screen 900, an end icon 990 for ending the function selection process is displayed.

Next, the operation input receiving unit 12 of the requesting terminal (terminal 10aa) determines whether the function selection icon 910 or the function selection icon 920 shown in FIG. 18 is selected by the user (step). S29-2). If it is determined in step S29-2 that none of the icons has been selected, the transmission / reception unit 11 is further moved from another dedicated terminal (or another terminal in which the dedicated terminal function is activated). It is determined whether or not the call start request has been accepted (step S29-3). Then, if it is determined in step S29-3 that the call start request is not accepted (NO), the process returns to the process of step S29-1. On the other hand, if it is determined in step S29-3 that the call start request has been accepted (YES), the activation unit 17 activates the dedicated terminal function (step S29-4). As a result, the terminal 10aa can start a call as a dedicated terminal.

Further, when it is determined in step S29-2 that either the function selection icon 910 or the function selection icon 920 is selected, the operation input receiving unit 12 further activates the dedicated terminal function. It is determined whether or not the selection icon 910 is selected (step S29-5). When it is determined in step S29-5 that the function selection icon 910 has been selected, the activation unit 17 activates the dedicated terminal function (step S29-6). In this case, the terminal 10aa can start a call as a dedicated terminal through steps S41 to S49 described later.

On the other hand, if it is determined in step S29-5 that the function selection icon 910 has not been selected (the function selection icon 920 has been selected), the transmission / reception unit 11 of the requesting terminal (terminal 10aa) manages the function selection icon 910. The terminal status information indicating that the non-dedicated terminal function is being activated is transmitted to the system 50 (step S29-7). By this transmission, the management system 50 updates the operating state of the terminal ID corresponding to the terminal 10aa in the terminal state management table to a state indicating that the non-dedicated terminal function is being activated. Further, the activation unit 17 of the requesting terminal (terminal 10aa) activates the non-dedicated terminal function (step S29-8). However, when the requesting terminal (terminal 10aa) operates as a non-dedicated terminal, the destination list described later as shown in FIG. 20 is not displayed, so that the user can specify the destination to specify the destination terminal. You must enter the address information (for example, IP address) that can identify the location of. Therefore, when the user inputs, for example, the IP address of the destination terminal (non-dedicated terminal), the operation input reception unit 12 accepts the designation of the destination (step S29-9). As a result, the requesting terminal (terminal 10aa) can start a call as a non-dedicated terminal.

Specifically, the requesting terminal sends a call start request addressed to the input IP address to the management system 50, and in the management system 50, the operating state of the terminal ID of the requesting terminal is determined in the terminal status management table. Since it indicates that the non-dedicated terminal function is activated, the conversion unit 57 converts the received call start request into data according to the conversion data rules (that is, according to the call control method of the non-dedicated terminal). .. The converted call start request is transmitted to the destination terminal (non-dedicated terminal) based on the IP address received from the management system 50. The destination terminal (non-dedicated terminal) that receives the call start request responds to the management system 50 if the call is possible, and the management system 50 converts the call start request according to the conversion data rule in the same manner as the call start request. Transfers the response to the requesting terminal. By a series of call control processes, a communication session sed can be established between the requesting terminal and the destination terminal as shown in FIG. In the case of FIG. 4, since the requesting terminal is activating the non-dedicated terminal function, the same AVC coding method as the destination terminal (non-dedicated terminal) is used as the coding method.

In step S29-9, the user was required to input the IP address, but the terminal 10 stores the location information such as the IP address of the non-dedicated terminal in advance so that the user can select from the location information. You may.

Subsequently, the process from the process of step S29-6 shown in FIG. 17 to the start of the call will be described with reference to FIGS. 19 and 20. Note that FIG. 19 is a flowchart showing a process of displaying the destination list. Further, FIG. 20 is a conceptual diagram showing a destination list.

First, when the requesting terminal (terminal 10aa) receives the authentication result information indicating the result of being determined to be a terminal having a legitimate usage authority in step S25, the transmission / reception unit 11 passes through the communication network 2. The destination list request information indicating that the destination list is requested is transmitted to the management system 50 (step S41). As a result, the transmission / reception unit 51 of the management system 50 receives the destination list request information.

Next, the extraction unit 54 of the management system 50 searches the destination list management table (see FIG. 14) using the terminal ID "01aa" of the requesting terminal (terminal 10aa) that requested the login as a search key, and searches the destination list management table (see FIG. A candidate terminal ID of a destination terminal capable of making a call with the terminal 10aa) is extracted, and the terminal state management table (see FIG. 13) is searched using this terminal ID as a search key, and the corresponding destination name information is extracted. (Step S42). Here, for the sake of simplification of the description, the case where each terminal ID such as the terminal 10ab, the terminal 10ba, the terminal 10ca, and the terminal 10cc as the dedicated terminal A is extracted as the candidate terminal 10 of the destination terminal will be continuously described below. To do.

Next, the extraction unit 54 reads the data of the destination list frame from the storage unit 5000 (step S43). Then, the transmission / reception unit 51 requests the request source terminal (terminal) for the "destination list information (destination list frame, terminal ID, destination name)" including the destination list frame and the terminal ID and destination name information extracted in step S42. 10aa) (step S44). As a result, in the requesting terminal (terminal 10aa), the transmission / reception unit 11 receives the destination list information.

Next, the storage / reading processing unit 19 of the requesting terminal (terminal 10aa) stores the destination list information in the storage unit 1000 (step S45).

As described above, in the present embodiment, the destination list information is not managed by each terminal 10, but the management system 50 centrally manages the destination list information of all the terminals. Therefore, a new terminal 10 is used in the call system 1, a new model terminal 10 is included in place of the already used terminal 10, and the appearance of the destination list frame is changed. Even if this happens, the management system 50 will handle it all at once, so it is possible to save the trouble of changing the destination list information on each terminal 10.

Further, on the management system 50 side, the extraction unit 54 extracts the operating state of the terminal 10 as a candidate for the destination terminal (step S46).

Next, the transmission / reception unit 51 includes the terminal ID "01ca" as the search key used in step S42 and the operating state "online (call possible)" of the corresponding destination terminal (terminal 10ca). "Terminal status information" is transmitted to the requesting terminal (terminal 10aa) via the communication network 2 (step S47). The transmission / reception unit 51 may transmit the terminal ID of the request source terminal (terminal 10aa) itself and "terminal status information" indicating the operating status to the request source terminal (terminal 10aa).

Next, the storage / reading processing unit 19 of the requesting terminal (terminal 10aa) sequentially stores the state information of the terminal received from the management system 50 in the storage unit 1000 (step S48). Therefore, the requesting terminal (terminal 10aa) can acquire the current operating state of another terminal 10 capable of making a call with the requesting terminal (terminal 10aa) by receiving the status information of each of the above terminals. it can.

Next, the destination list creation unit 18 of the requesting terminal (terminal 10aa) reflects the state of the terminal 10 as a destination candidate based on the destination list information stored in the storage unit 1000 and the state information of the terminal. Along with creating the destination list 2100, the display control unit 16 causes the display 120aa shown in FIG. 1 to display the destination list 2100 as shown in FIG. 20 (step S49). Further, in order to reflect the state of the terminal 10 in the destination list, the following processing is performed. That is, the destination list creation unit 18 extracts the corresponding visual information by searching the visual information management table (see FIG. 10) based on the operating state information of the terminal included in the state information of the terminal. Then, the destination list creation unit 18 assigns the extracted visual information to the destination list frame in the destination list information for each terminal ID and destination name in the destination list information. In FIG. 20, the operating states of the four destination candidates (2110, 2120, 2130, 2140) are represented by icons as an example of visual information. As a result, the user can recognize the operating state of the destination candidate before starting the call.

A return icon 2300 (an example of a third icon) for returning to the function selection screen 900 shown in FIG. 18 is displayed below the destination list 2100. Further, a scroll bar 2200 is displayed on the right side of the destination list 2100, and when the user moves the scroll bar 2200 up and down, the visual information displayed in the destination list moves up and down. ..

<< Main effects of this embodiment >>
As described above, according to the present embodiment, there is an effect that a plurality of types of call functions using communication methods having the same call control method but different coding methods can be used properly.

<< Supplement to the embodiment >>
In the above embodiment, as shown in FIG. 18, the selection of two types of functions has been described, but the present invention is not limited to this, and three or more types of functions may be selected.

Further, in the above embodiment, in FIGS. 18 and 20, the icon displayed on the display 120 by the video conferencing terminal as an example of the calling terminal has been described, but as shown in FIGS. 21 and 22, the smartphone ( A terminal 10'such as a Smartphone) may display various icons on the display 120'. Note that FIG. 21 is a conceptual diagram showing another example of the function selection screen. Further, FIG. 22 is a conceptual diagram showing another example of the destination list. In FIGS. 21 and 22, the terminal 10', the operation button 108', the microphone 114', the speaker 115', the display 120', the function selection icon 910', and the function selection icon 920'are the terminals 10 in the video conference terminal, respectively. , Operation button 108, microphone 114, speaker 115, display 120, function selection icon 910, and function selection icon 920.

Further, in FIG. 22, the destination list 2100', the destination candidate (2110', 2120', 2130', 2140'), the scroll bar 2200', and the back icon 2300'are the destination list 2100 and the destination candidate, respectively, in the video conference terminal. Corresponds to (2110, 2120, 2130, 2140), scrollbar 2200, and back icon 2300.

Further, in the various icons shown in FIGS. 10, 18, and 20, not only pictograms but also characters and symbols may be included in the pictograms.

Further, in the above embodiment, transmission / reception of image data and audio data has been described, but the present invention is not limited to this. Only voice data may be transmitted and received. In this case, the merit of the videophone cannot be utilized, but the conference by only the telephone is possible like the ordinary telephone.

Further, the relay device 30, the management system 50, the program providing system 90, and the maintenance system 100 in the above embodiment may be constructed by a single computer, or each part (function or means) may be divided and arbitrarily assigned. It may be built by a plurality of computers. Further, when the program providing system 90 is constructed by a single computer, the program transmitted by the program providing system 90 may or may not be divided into a plurality of modules and transmitted. It may be sent. Further, when the program providing system 90 is constructed by a plurality of computers, the plurality of modules may be separated and transmitted from each computer.

Further, a recording medium such as a CD-ROM in which each program of the above-described embodiment is stored, an HD204 in which these programs are stored, and a program providing system 90 provided with the HD204 are all program products. Can be provided domestically or internationally.

Further, although the reception date and time are managed in FIGS. 11, 13, and 15, the reception date and time is not limited to this, and at least the reception time of the reception date and time may be managed.

Further, in the above embodiment, the IP address of the relay device is managed in FIG. 11 and the IP address of the terminal is managed in FIG. 13, but the present invention is not limited to this, and the relay device 30 is specified on the communication network 2. If it is the destination information of the above or the destination information for identifying the terminal 10 on the communication network 2, each FQDN (Fully Qualified Domain Name) may be managed. In this case, a well-known DNS (Domain Name System) server will acquire the IP address corresponding to the FQDN.

Further, in the above embodiment, the case of a video conferencing system has been described as an example of the calling system 1, but the present invention is not limited to this, and a telephone system such as an IP (Internet Protocol) telephone or an Internet telephone may be used. .. Further, the call system 1 may be a car navigation system. In this case, for example, one of the terminals 10 corresponds to a car navigation device mounted on a car, and the other of the terminals 10 is mounted on a management terminal or management server of a management center that manages car navigation, or another car. Corresponds to a car navigation device. Further, the communication system 1 may be a communication system of a mobile phone. In this case, for example, the terminal 10 corresponds to a mobile phone.

Further, in the above embodiment, image data and voice data have been described as an example of call data, but the present invention is not limited to this, and tactile (touch) data may be used. In this case, the feeling that the user touches on one terminal side is transmitted to the other terminal side. Further, the call data may be smell data. In this case, the odor (smell) on one terminal side is transmitted to the other terminal side. Further, the call data may be at least one of image data, voice data, tactile data, and olfactory data.

Further, in the above embodiment, the case of having a video conference by the telephone system 1 has been described, but the present invention is not limited to this, and is not limited to this, and is not limited to this, and is used for meetings, general conversations between family members, friends, etc., or information in one direction. It may be used for presentation.

Further, the external view of the telephone terminal of the terminal shown in FIG. 6 is merely an example, and may be a smartphone, a tablet terminal, a mobile phone, or a general-purpose PC. The microphone and camera do not necessarily have to be built-in, but may be external.

Further, in FIGS. 2 and 4, the call control method of the requesting terminal is the instant messenger protocol (or a protocol extended from the instant messenger protocol), and in FIG. 4, the call control method of the destination terminal is SIP (Session Initiation). Although it has been described as Protocol) or H.323, it is merely an example and may be a call control method other than the above.

1 Call system 10 Call terminal 11 Transmitter / receiver (example of transmission means, example of reception means)
12 Operation input reception unit (example of reception means)
16 Display control unit (an example of display control means)
17 Starter (example of starter)
18 Destination list creation unit 30 Relay device 50 Call management system 90 Program provision system 100 Maintenance system 910 Function selection icon (example of the first icon)
920 function selection icon (an example of the second icon)
1000 Storage unit 1001 Visual information management DB (an example of visual information management means)
2300 Back icon (an example of the third icon)
5000 storage unit (an example of storage means)
5001 Relay device management DB
5002 Terminal authentication management DB
5003 Terminal state management DB
5004 Destination list management DB
5005 Session management DB

Japanese Unexamined Patent Publication No. 2008-227757 Japanese Unexamined Patent Publication No. 2001-326972

Claims (7)

A first method of making a call to a predetermined display means by using a predetermined call control method for connecting or disconnecting a call destination and a predetermined coding method for converting call data into an IP packet. A first icon for accepting a selection of a call function, and a second icon for accepting a selection of a second call function having the same call control method but different coding method from the first call function. Display control means to display the function selection screen showing
A reception means that accepts the selection of the first icon or the second icon, and
When the selection of the first icon is accepted, the first call function is activated, or when the selection of the second icon is accepted, the second call function is activated, and the activation means.
A telephone terminal characterized by having. If a call start request made by using the first call function is received from another call terminal having the first call function before the selection is accepted by the reception means, the above-mentioned The call terminal according to claim 1, wherein the activation means activates the first call function. When the selection of the second icon is accepted by the receiving means, the operating state indicating that the second calling function is being activated for the call management system that manages the operating state of the calling terminal. The telephone terminal according to claim 1, further comprising a transmission means for transmitting information. The display control means displays a destination list indicating an operating state of a destination candidate on the predetermined display means, and causes the display means to display the function selection screen on the destination list. Display the icon of 3 and
The reception means accepts the selection of the third icon,
The telephone terminal according to claim 1, wherein when the selection of the third icon is accepted, the display control means causes the display means to display the function selection screen. The call terminal according to any one of claims 1 to 4, wherein the call data includes at least voice data. A first method of making a call to a predetermined display means by using a predetermined call control method for connecting or disconnecting a call destination and a predetermined coding method for converting call data into an IP packet. A first icon for accepting the selection of the call function, and a second icon for accepting the selection of the second call function having the same call control method as the first call function but different from the coding method. Display control steps to display icons and
A reception step that accepts the selection of the first icon or the second icon, and
An activation step of activating the first call function when the selection of the first icon is accepted, or activating the second call function when the selection of the second icon is accepted, and
A call function activation method characterized by executing. A program comprising causing a computer to perform each step according to claim 6.

Images