JP2004165949A - Tv phone system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a TV phone wherein a portable audio terminal for conversation and an image terminal for transmitting/receiving an image have different bodies respectively, call setting is processed on the managing server side, and the portable audio terminal and the image terminal are combined during the phone conversation at the portable audio terminal. <P>SOLUTION: This TV phone system comprises the image terminal for transmitting/receiving the image, the audio terminal for radio transmitting/receiving a voice, a radio-wired communication conversion terminal for mutually converting radio communication and wired communication, a managing means for managing terminal information about a plurality of image terminals and audio terminals, a call control means for controlling calls between the terminals according to the information of the managing means, and a managing server composed of a communication means for communicating with the audio terminals and the image terminals. Control by the managing server is carried out until logical audio data channels between the audio terminals and the logical data channels between the image terminals have been established. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a videophone system that is connected to a packet communication network via ISDN, ADSL, CATV, etc., and performs communication of moving images, voices, still images, and other multimedia information between remote points.
[0002]
[Prior art]
As packet communication terminal devices for transmitting moving images, voices, still images, and other multimedia information on a LAN, ITU-T to H.264. 323 is recommended. This H. With the use of terminal equipment according to the H.323 recommendation, an IP telephone using a LAN, an IP video telephone system, and the like can be realized. Along with this, there has been a movement to unify in-house infrastructure for data communication, telephone, and the like into a LAN.
[0003]
FIG. 3 shows a block diagram of a H.323 communication terminal. 401, a video input device such as a video camera; 402, a video encoding unit that compresses and encodes a video signal from the video camera 401; 403, an audio input device such as a microphone; 404, an audio signal from the microphone 403; An audio encoder for encoding 405 is a packet controller for packetizing the encoded video information and audio information into video packets and audio packets, and 406 is a packet controller for depacketizing received video and audio packets. A depacket control unit for configuring video information and coded audio information; 407, a video decoding unit for expanding and decoding received coded video information; 408, a video output device such as a video monitor; 409, received coded audio An audio decoding unit for decoding information; 410, an audio output device such as a speaker; Is LAN I / F for interfacing with the LAN.
[0004]
A call control / system control unit 412 provides signaling for appropriate operation. Functions provided include call control, capability information exchange, command and notification signaling, and the opening of logical channels. Further, it provides functions of logical framing, sequence number addition, error detection, and error correction according to each media type. 413 arranges the transmitted video, audio, data and control streams according to the format so as to be output to the LAN I / F section 411, and converts the video, audio, data and control streams received from the LAN I / F section 412 into data. The packet is extracted and distributed to the depacket control unit 405 and the call control / system control unit 413.
[0005]
Next, with reference to FIG. The connection procedure of the H.323 terminal will be described. 8, reference numeral 801 denotes a gatekeeper for controlling a call, and 802-1 and 802-2 denote H.264. 323 terminals. First, call setting 1 for making a call from 801-1 to 802-2 is sent to gatekeeper 801. In response to this, the gatekeepers 801 to 802-2 receive the H.264 message. Call setting 2 is sent to the H.323 terminal.
[0006]
802-2. When this call setting is accepted on the side of the H.323 terminal, Response 3 is sent to the gatekeeper 801, and the gatekeeper 801 receives the call setting, and Response 4 is sent to the H.323 terminal. By this response, the communication control channels 5 and 6 are transmitted to the gatekeeper 801 and the H.264. 323 terminals 802-1 and 802-2. The capability information is exchanged between the terminals using the communication control channel, the video and audio communication modes are determined between the terminals, and the audio logical data channel 7 and the video logical data channel 13 are opened. The audio and the video encoded using are communicated.
[0007]
(In the description here, the communication control channel is connected via the gatekeeper. However, this is to explain the one closest to the present embodiment. In addition, when only the address resolution is performed by the gatekeeper Alternatively, call setup and response are performed via a gatekeeper, and a communication control data channel beyond that is established directly between terminals.
[0008]
[Problems to be solved by the invention]
However, in the above-described conventional H.264. 323 In the terminal (TV phone), camera, monitor, handset, etc. has been a installation of absolutely fixed because it is integral. For this reason, H. When an H.323 terminal (videophone) is actually assigned to an extension in a company, an H.323 terminal (video telephone) is assigned to each desk in comparison with an extension system or the like in which one telephone number is assigned to each one using PHS or the like in recent years. Installing a 323 terminal (videophone) has become somewhat unacceptable because it feels like returning to a traditional fixed telephone in a sense.
[0009]
Also, with the increase in the communication speed of mobile phones, it has become possible to make videophone calls using mobile phones.However, since the display unit and camera are mounted on the main unit, hold the phone away from yourself and hold yourself It was very difficult to use the mobile phone while talking, and it was difficult to achieve both the portability of a mobile phone and the convenience of a videophone.
[0010]
[Means for Solving the Problems]
In order to solve the above problems, in the present invention,
A video imaging unit, a video encoding unit that encodes a video signal captured by the video imaging unit, a video decoding unit that decodes the encoded video signal, and a video signal that is decoded by the decoding unit. Video display means for displaying the video signal, and a video terminal comprising a communication means for communicating data via a communication line,
Voice input means, voice coding means for coding a voice signal input from the voice input means, voice decoding means for decoding the coded voice signal, and decoding by the voice decoding means Sounding means for converting the sound signal into sound, and a voice terminal comprising wireless communication means for wirelessly communicating data,
A wireless wired communication conversion terminal for mutually converting between wireless communication and wired communication,
Management means for managing terminal information of the plurality of video terminals and audio terminals; call control means for performing call control between terminals based on the information of the management means; and communication control for communicating with the audio terminals and the video terminals Management server consisting of means,
The management server performs control until a logical audio data channel between the audio terminals and a logical data channel between the video terminals are opened, so that two different terminals (a video terminal and an audio terminal) are connected to one terminal. It works in cooperation with.
[0011]
Also, by updating the information of the management means in the management server, the combination of the audio terminal and the video terminal can be freely changed, so that the combination can be determined as necessary.
[0012]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings.
[0013]
FIG. 1 is a diagram showing an overall configuration of a videophone system according to a first embodiment of the present invention.
[0014]
In FIG. 1, reference numerals 200-1 and 200-2 denote video terminals for inputting and outputting video, and reference numerals 300-1 and 300-2 denote audio terminals for inputting and outputting audio. Reference numeral 101 denotes a management server that manages a plurality of video terminals and audio terminals. Each part of the management server 101 will be described. 111 is a communication control unit for communicating with and controlling the video terminal 200 and the portable audio terminal 300; 112 is a call control means for performing call control for connecting a voice telephone call and a video telephone call on a LAN; 6 is a management table for managing combinations of video terminals and audio terminals managed by the communication control unit 111. Reference numeral 102 denotes a wireless LAN access point for converting a LAN signal into a wireless signal, and reference numeral 103 denotes an H.102 for making a videophone call via a conventional LAN. 323 terminals.
[0015]
FIG. 2 is an internal configuration diagram of the video terminals 200-1 and 200-2 in FIG. In FIG. 2, reference numeral 201 denotes a camera unit for inputting video, 202 denotes a video encoding unit for encoding a video signal input from the camera unit 201, and 203 transmits video code data encoded by the video encoding unit 202. A packetization control unit for performing packetization, sequence number addition, error detection code addition, error correction code addition, etc., 204 is a protocol control unit for transmitting and receiving packet data and transmitting and receiving control signals, and 205 is a received packet. A depacketizing control unit that separates data into video code data, a sequence number, an error detection code, an error correction code, and the like; a video decoding unit that decodes video code data separated by the packetization control unit in 205 into a video signal; Reference numeral 207 denotes a monitor for displaying a video signal decoded by the video decoding unit 206, and 208 denotes a video signal. An operation unit 209 for operating the terminal 200, a system control unit 209 for communicating input information from the operation unit and information of the video terminal 200 and controlling the system, and 210, a LAN I which is a physical interface with a LAN / F.
[0016]
FIG. 3 is an internal configuration diagram of the portable audio terminals 300-1 and 300-2 in FIG. In FIG. 3, reference numeral 301 denotes a microphone for inputting audio, 302 denotes an audio encoding unit that encodes an audio signal input from the microphone 301, and 303 denotes an audio encoder for transmitting the audio code data encoded by the audio encoder 302. A packetization control unit that performs packetization, sequence number addition, error detection code addition, error correction code addition, etc., 304 is a protocol control unit for transmitting and receiving packet data and transmitting and receiving control signals, and 305 is for transmitting received packet data. A depacketizing control unit for separating voice code data, a sequence number, an error detection code, an error correction code, and the like; 306, a voice decoding unit for decoding the voice code data separated by the packetization control unit 305 into a voice signal; A speaker 308 for converting the video signal decoded by the audio decoding unit 306 into sound; 0, a system control unit 309 for communicating input information from the operation unit and information of the voice terminal 300 to control the system, and 310, a wireless LAN I / F which is an interface with a wireless LAN. is there.
[0017]
Next, examples in which the above-described system is used will be sequentially described with reference to FIG.
[0018]
The management server 101 manages the correspondence between the IP address of each portable voice terminal and the extension number in the management table 113, and H.323 acts as a gatekeeper. Here, a procedure for making a call from the portable voice terminal 300-1 to the portable voice terminal 300-2 will be described with reference to FIG.
[0019]
The portable voice terminal 300-1 notifies the management server 101 that a call is to be made to the extension number of the portable voice terminal 300-2 (1 call setting). In response to this, the management server 101 transmits the call setting from the portable voice terminal 300-1 to the portable voice terminal 300-2 (2 call setting). In response to this call setting, portable voice terminal 300-2 returns a response to accept the call setting (3 responses). In response to this, the management server 101 notifies the portable voice terminal 300-1 that there is a response from the other party (4 responses).
[0020]
With this response, a communication control channel (5, 6 communication control channel) is opened between the management server 101 and the portable audio terminals 300-1 and 300-2, and the terminal exchanges capabilities and transmits encoded audio data. And the like for establishing a logical data channel for the communication. By this information exchange, a logical data channel (7 voice logical data channel) is opened, and voice data encoded using the RTP and RTCP protocols is communicated using this channel. A conversation by voice becomes possible between 1 and 300-2.
[0021]
Next, a procedure when the portable audio terminal 300-1 and the video terminal 200-1 are used in cooperation as a videophone will be described with reference to FIG. The user of the portable audio terminal 300-1 inputs the extension number of the portable audio terminal 300-1 to be linked with the video terminal 200-1 from the operation unit of the video terminal 200-1. This input information is sent to the management server 101, the management table 113 in the management server is updated, and the IP address of the video terminal 200-1 and the mobile phone And the terminal capability obtained by the combination of the video terminal and the video terminal (the video capability such as H.261 and H.263 of the video terminal is added to the portable audio terminal 300-1 which initially had only the capability of the audio terminal, Registered in the management table 113.)
[0022]
Then, this information is sent to the portable voice terminal 300-2 as the terminal capability of the new portable voice terminal 300-1. At this time, the mobile terminals 300-2 and 300-2 are associated with each other in the same procedure as the video terminal 200-2, so that the video terminals 200-1 and 200-2 can call the mobile terminals 300-1 and 300-2, respectively. It can operate as video input / output.
[0023]
The procedure from the registration of the video terminal to the establishment of the video channel will be described with reference to FIG. When the telephone number of the portable audio terminal 300-1 is input from the operation unit of the video terminal 200-1, a request to open a control channel is issued from the video terminal 300-1 to the management server 101 (8 control channel opening request).
[0024]
With this request, a communication control channel is opened between the management server 101 and the video terminal 200-1 (9 communication control channels), and the telephone of the portable audio terminal 300-1 to be associated with the video terminal 200-1 using this channel. The number, the video encoding capability of the video terminal, the maximum frame rate, the data transfer capability, and the like are sent to the management server, the management table in the management server is updated, and the video terminal 200 receives the extension number of the portable audio terminal 200-1. An IP address of -1, a terminal capability obtained by a combination of the portable audio terminal and the video terminal, and the like are registered. Similarly, when the video terminal 200-2 receives the telephone number of the portable audio terminal 200-2 from the operation unit, the video terminal 200-2 issues a control channel opening request to the management server 101 (10). Control channel opening request).
[0025]
With this request, a communication control channel is established between the management server 101 and the video terminal 200-1 (11 communication control channel), and the telephone of the portable audio terminal 300-1 to be associated with the video terminal 200-1 using this channel. The number, the video encoding capability of the video terminal, the maximum frame rate, the data transfer capability, etc. are sent to the management server, the management table in the management server is updated, and the video terminal 200 is assigned to the extension number of the portable audio terminal 200-2. -2 IP address, terminal capability obtained by the combination of the portable audio terminal and the video terminal, and the like are registered. At this point, the terminals at the two points are ready for voice and video communication.
[0026]
Here, when a request to start video communication is issued from the portable audio terminal 300-1 as a trigger for starting the video communication (12 video communication start request), the management server 101 receives the request from the video terminals 200-1 and 200-2. The communication mode is determined based on the capability information of the terminal, and information for opening the communication mode and the video logical channel using the communication control channels 8 and 10 for each video terminal is transmitted to the video terminal 200-1. Set to 200-2. Based on this information, the video terminals 200-1 and 200-2 open a video logical channel (13 video logical channels) and start video communication.
[0027]
So far, the method of communication between the video terminal and the portable audio terminal has been described. A case where communication is performed with a H.323 terminal will be described. The portable audio terminal 300-1 of FIG. Procedures until the H.323 terminal 103 performs voice communication are 1 to 7 in FIG. The procedures 1 to 7 are the same as the procedures between the voice terminals described with reference to FIG.
[0028]
Here, when the user of portable audio terminal 300-1 inputs the extension number of portable audio terminal 300-1 from the operation unit of video terminal 200-1, video terminal 200-1 requests the management server to open a control channel. Is issued (8 control channel opening request).
[0029]
With this request, a communication control channel is established between the management server 101 and the video terminal 200-1 (9 communication control channels). Then, using this channel, the telephone number of the portable audio terminal 300-1 to be associated with the video terminal 200-1, the video encoding capability of the video terminal, the maximum frame rate, the data transfer capability, and the like are sent to the management server 101. The management table 113 in the management server is updated, and the IP address of the video terminal 200-1 and the terminal capability obtained by the combination of the mobile voice terminal and the video terminal are registered with the extension number of the mobile voice terminal 300-1. Is done.
[0030]
Here, when a start request for video communication is issued from the portable audio terminal 300-1 as a trigger for starting the video communication (12 a video communication start request), the management server 101 sets the mobile phone terminal 300-1 and the video terminal 200- The terminal capability obtained by combining the communication control channel 6 with the H. The H.323 terminal 103 exchanges capabilities with the terminal 103, determines the communication mode including the video, sets the newly determined communication mode to each terminal using the communication control channels 5, 6, and 9, and sets the video logical data. The channel 13 is opened, and video / audio communication is performed in the communication mode set using the audio logical data channel 7 and the video logical data channel 13.
[0031]
【The invention's effect】
As can be easily understood from the above description, according to the present invention, the call setting is processed on the management server side, with the audio terminal for conversation and the video terminal for transmitting and receiving video being separate. As a result, a portable audio terminal and a video terminal can be combined and used as a videophone during a call with the portable audio terminal. For this reason, it is also possible to receive a call with a portable audio terminal while on the go and use it as a videophone in combination with a nearby video terminal, making it possible to increase the portability of the portable audio terminal and the convenience of the videophone as needed. Can be used properly.
[Brief description of the drawings]
FIG. 1 is a diagram showing an overall configuration of a videophone system according to a first embodiment of the present invention; FIG. 2 is an internal configuration diagram of video terminals 200-1 and 200-2 in FIG. 1 FIG. FIG. 4 is an internal configuration diagram of the portable voice terminals 300-1 and 300-2 of FIG. FIG. 5 is an explanatory diagram of a procedure for making a call from the portable audio terminal 300-1 to the portable audio terminal 300-2. FIG. 6 is a procedure from registration of a video terminal to establishment of a video channel. FIG. 7 is a diagram illustrating the portable audio terminal 300-1 of FIG. FIG. 8 is a flowchart showing a procedure until the H.323 terminal 103 performs voice communication. Diagram explaining the connection procedure of the H.323 terminal
201 Camera unit 202 Video encoding unit 203 Packetization control unit 204 Protocol control unit 205 Depacket or control unit

Claims (2)

A video imaging unit, a video encoding unit that encodes a video signal captured by the video imaging unit, a video decoding unit that decodes the encoded video signal, and a video signal that is decoded by the decoding unit. Video display means for displaying the video signal, and a video terminal comprising a communication means for communicating data via a communication line,
Voice input means, voice coding means for coding a voice signal input from the voice input means, voice decoding means for decoding the coded voice signal, and decoding by the voice decoding means Sounding means for converting the sound signal into sound, and a voice terminal comprising wireless communication means for wirelessly communicating data,
A wireless wired communication conversion terminal for mutually converting between wireless communication and wired communication,
Management means for managing terminal information of the plurality of video terminals and audio terminals; call control means for performing call control between terminals based on the information of the management means; and communication control for communicating with the audio terminals and the video terminals Management server consisting of means,
A video telephone system, wherein the management server performs control until opening a logical audio data channel between the audio terminals and a logical data channel between the video terminals. 2. The videophone system according to claim 1, wherein a combination of the audio terminal and the video terminal can be freely changed by updating information of a management unit in the management server.

Images