JP3466683B2 - Multimedia communication device and multimedia communication method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION The present invention relates to audio information, image information,
A multimedia communication device and multimedia communication represented by an AV (Audio Visual) communication device such as a videophone device and a video conference system capable of multiplexing and communicating multimedia information such as data.
Regarding the method .

[0002]

2. Description of the Related Art In recent years, communication services using ISDN (Integrated Services Digital Network) lines have started to be put into practical use, and AV services such as video telephone devices and video conference systems using such digital lines have been receiving attention. The service specifications, protocol specifications, multimedia multiplexing frame structure, moving image information encoding method, etc. for AV services are recommended by CCITT (International Telegraph and Telephone Consultative Committee) “H.
320 "," H.242 "," H.221 "," H.2 "
30 "," H.261 ", etc.
In "H.221", 64 kbps to 1920 kbps
The frame structure in the AV service on the channel is specified.

[0003] Fig. 6 shows a frame structure of "H.221" on a 64 kbps x 1 channel. Numbers 1 to 8 on the horizontal axis are bit numbers and numbers 1 to 80 on the vertical axis are octet numbers. , 80 octets make up one frame. The FAS (frame synchronization signal) in the figure controls the frame synchronization / multi-frame synchronization, the communication quality monitoring function, and the alarm information notification.

FIG. 7A shows one multiframe of FAS = 8 submultiframes (one submultiframe =
It is a figure which shows the bit assignment between (2 frames). In addition, the BAS (bit rate allocation signal) is used to specify the terminal capability, the bit rate allocation for each medium in the actual frame, and various other controls and notifications. Figure 7
As shown in (b), the BAS is transmitted in even frames and the corresponding error correction bits are transmitted in odd frames.

In "H.242", communication procedures such as a capability information exchange sequence and a mode switching sequence using an in-channel BAS between AV terminals are specified.
“H.320” defines system aspects of AV services in general. “H.230” defines various controls and notifications that require transmission frame synchronization or an emergency response, as additional information for functions required for AV services. Px64 kbp for "H.261"
A coding / decoding method of moving image information at a speed of s (p = 1 to 30) is defined.

FIG. 8 shows a basic sequence when multimedia communication of images, voices, data (all user information other than images and voices), etc. is performed in accordance with the above recommendations. First, when a multimedia communication device (hereinafter, referred to as a calling side device) that wants to start communication is activated, an out-channel call control is activated and an incoming call is notified to the partner side device.
In the case of the ISDN line, the call setup sequence by the D channel (ch) is activated.

In the receiving side device, first, in step S of FIG.
At 801 it is determined whether the incoming call is a videophone call. I
In SDN line, setup for Dch call control (set
up) BC information element and H in the message
It is determined whether the call is a telephone call, a videophone call or a completely different call based on the LC (higher layer compatibility) information element / LLC (lower layer compatibility) information element.

If it is determined in step S801 that the call is not a videophone call, the processing operation is terminated without doing anything. If it is determined that the call is a videophone call, the process proceeds to step S802 to set a Dch call. , Establish a first connection. Next, in step S803, the set connection (Bch in ISDN,
Frame synchronization is established by FAS search / detection and transmission / detection of A bit = 0 in Hch). After the synchronization is established, the process proceeds to step S804, and the capability of the partner device is judged by the capability information exchange sequence by the BAS transmission / reception detection. Next, in step S805, the multimedia multiplexing allocation on the first connection established in step S802 is determined, and B
A multimedia switching communication is started by performing a mode switching sequence by transmitting / receiving an AS command.

Actually, in this case, in many cases, only voice information communication is performed when the additional connection is continuously established. For example, voice 56kbps / "H2
61 "Communication is started in the image off mode. After that, the process proceeds to step S806, and when it is determined that the additional connection capability is present on both the own device side and the partner device side, the process proceeds to the next step S807 to establish the additional connection. Then, in step S808, FAS search / detection of the additional connection and frame synchronization / multi-frame synchronization and synchronization establishment processing with the first channel are performed using the A bit, and then the process returns to step S806 to add the additional connection again. To determine whether it is necessary.

When the need for additional connection is eliminated, the operation proceeds to step S809 to determine an operation mode suitable for use of all channels, perform a mode switching sequence by transmitting / receiving a BAS command, for example, "H.261" video transmission on ( ON) ・ After changing the voice coding to the optimum coding between both terminals and performing multimedia multiplex communication,
This processing operation ends. However, the mode switching sequence by the BAS command performed in step S809 may be performed each time immediately after execution of the synchronization establishing step S808 for each additional connection.

Unlike a response message containing only voice information of an ordinary telephone and a response message containing only voice information in an answering machine (answering machine recording) mode in a videophone device / videoconference system, a response message containing audio information including video information. , The audio information and video information are transmitted in a multiplexed form on the transmission line. What kind of multiplexing is used is the ability information exchange with the other device that is actually connected. It cannot be judged until after the sequence is executed. Further, since the video coding of “H.261” uses the inter-frame predictive coding method, it is always available by simply recording the coded audio information / video information as a response message. Not necessarily. As a simple method, a method of transmitting a response message using an analog video / audio storage medium such as a VTR (video tape recorder), or simply on a digital storage medium such as HD (hard disk) / MOD (magneto-optical disk) A method of using digitized audio information / video information as a response message is possible. In the case of simply encoding and accumulating voice information and transmitting it as a response message, some analog telephones also use a method of decoding and re-encoding and transmitting.

[0012]

However, in the case of using an analog storage medium such as a VTR in the above-mentioned conventional example, a dynamic selection of a plurality of response messages cannot be performed immediately when reproducing later, and There is a problem that the device itself becomes large and expensive.

Further, when a digital storage medium such as an HD is used, there is a problem that a very large storage capacity is required because moving image information is stored.

In a simpler method of storing moving picture coded information,
There was a problem that the decryption display on the partner device did not work well even if it was sent.

The present invention has been made in view of the above problems of the above-mentioned conventional technique, and an object of the present invention is to suppress an increase in storage capacity for simultaneously handling moving image information. At the same time, it is an object of the present invention to provide a multimedia communication device and a multimedia communication method capable of making an answering machine answering message in a videophone function as an ordinary answering machine answering message.

[0016]

In order to achieve the above object, a multimedia communication apparatus of the present invention comprises a voice encoding / decoding means for encoding voice information and decoding the encoded voice information. A video encoding / decoding means for encoding the video information and for decoding the encoded video information, and the audio encoding / decoding means and the video encoding / decoding means. Multiplexing means for multiplexing multimedia information such as audio information, video information and data, and demultiplexing means for demultiplexing the multimedia information multiplexed by the multiplexing means so that each medium can be decoded. In the multimedia communication device having the above, the incoming call is automatically accepted at the time of absence, and the voice information and the video information for the response message recorded in the recording section in advance are received. A recorded message control means for controlling to later notify the remote terminal, the received audio information and video information, etc. from the partner terminal is recorded in the recording unit to be a recorded message mode to start signal, the answer phone a recording control means for recording in advance the recording unit audio information and video information for the response message in mode, the audio information and video information for the reply message at the time of recording in the recording unit, the The audio information is controlled so as to record the output of the audio encoding / decoding means and the video information so as to record the output of the video encoding / decoding means as encoded information in the recording unit , and Video information for the response message
Is the maximum video that the multimedia communication device can send
It is encoded according to the transmission rate and recorded in the recording unit.
Recording control means for controlling the
When sending audio / video information for answer messages
The encoded voice information is directly input to the multiplexing means.
Input control means for controlling as described above, and recording in the recording section
The audio / video information for the response message
Sometimes, the encoded video information is converted into the video encoding / decoding.
It is input to the encryption means, decrypted, and matched with the capability of the partner terminal.
It is controlled so that it is encoded and input to the multiplexing means.
It is characterized in that and a second input control means for control. In addition, in order to achieve the above object,
The multimedia communication method encodes voice information and
Speech coding / decoding for decoding the coded speech information
And catheter stage was said encoded with encoding video information
Video encoding / decoding means for decoding video information;
Audio encoding / decoding means and video encoding / decoding means
Audio and video information and data encoded by the stage
Multiplexing means for multiplexing multimedia information such as data
The multimedia information multiplexed by the multiplexing means
Separation hand that separates each media so that it can be decrypted
A multimedia communication device having a stage.
When using the multimedia communication method,
Automatically accepts incoming calls and records them in the recording unit in advance
Open the transmission of audio and video information for the response message
After notifying the other terminal that it is in the answering machine mode for the first time,
The recording unit stores the audio information and video information received from the partner terminal.
Record control process to control to record on
Audio information / video for response message in recording mode
Recording system for controlling information to be recorded in the recording unit in advance
In the process, the voice information and video for the response message
When the image information is recorded in the recording unit, the audio information is
The output of the voice encoding / decoding means and the video information
Information in encoded form at the output of the video encoding / decoding means
Control to record in the recording unit as
The video information for the response message is the multimedia communication.
Encoded by the maximum video transmission rate that the device can transmit
And recording control step for controlling to record in the recording unit
And voice information for the response message recorded in the recording unit
・ When transmitting video information, the encoded audio information is directly
A first input system for controlling input to the multiplexing means
Process and sound for the response message recorded in the recording section
When transmitting voice information / video information, the encoded video
Input image information into the video encoding / decoding means for decoding
Then, the encoding is performed according to the capability of the partner terminal to
Second input control step for controlling input to the multiplexing means
And is provided.

[0017]

[0018]

[0019]

[0020]

[0021]

[0022]

Embodiments of the present invention will be described below with reference to FIGS.

[First Embodiment] FIG. 1 is a block diagram showing the configuration of a multimedia communication apparatus according to the first embodiment of the present invention. In the figure, 1 is a handset which is one of audio input / output means, 2 is a microphone which is one of audio input means, 3 is a speaker which is one of audio output means, and 4 is an audio interface (I / F) Function for switching between the handset 1, the microphone 2 and the speaker 3 as voice input / output means in accordance with an instruction from the system control unit 15 described later.
An on / off hook detection function for detecting whether the handset 1 is in an on-hook state or an off-hook state, an echo cancel function for canceling an echo when the microphone 2 and the speaker 3 are used as voice input / output means, a dial tone, It has tone generation functions such as ringing tone, busy tone, and ring tone. 5 is voice coding /
In the decoding unit, 64 kbps PCM (A-law), 64 kbp, according to an instruction from the system control unit 15 described later.
s PCM (μ-law), 64 kbps / 56 kbp
s / 48kbps SB-ADPCM, 32kbps
ADPCM, LD-CELP, 16kbps, 8kbps
It has a function of A / D-converting and encoding a transmission voice signal (information) and a function of D / A-converting and decoding a reception voice signal according to a voice signal (information) encoding / decoding algorithm such as s. .

Reference numeral 6 is an audio / video input / output unit such as a VTR (video tape recorder), and 7 is one of video input means,
A camera for inputting a self-portrait, 8 is one of image input means, and a document camera for inputting a picture, a drawing, etc.,
Reference numeral 9 denotes a display unit that displays an input image from the camera 7 or the document camera 8, a received image from the other party, an operation screen, and the like.
Is a video interface (I / F) unit, which has a function of switching between the camera 7 and the document camera 8 as image input means, a display switching between an input image, a received image, and an operation screen, and those by an instruction from a system control unit 15 described later. It has an image signal synthesizing function for split display on the display unit 9.

Reference numeral 11 is a video encoding / decoding unit (image codec unit), which is CCITT Recommendation "H.26".
1 ”, it has a function of A / D converting the transmission video signal (information) and encoding, and a function of D / A converting the reception video signal (information) and decoding.

Reference numeral 12 is a data terminal for transmitting and receiving data, and 13 is a data interface section, which is a data terminal 12
Also, the data transmitted from the system control unit 15 is notified to the multiplexing / demultiplexing unit 16, and the received data is notified to the data terminal 12 or the system control unit 15.

Reference numeral 14 denotes an operation unit such as a keyboard used for inputting control information for controlling the entire apparatus, 1
A system control unit 5 includes a CPU, a ROM, a RAM, an auxiliary storage device, and the like, monitors the state of each unit, and controls the entire unit, and determines the transmission rate assigned to each medium according to the input control information, the used line state, and the like. It is for calculating and finally determining / controlling the mode, creating an operation / display screen according to the state, and executing an application program such as a man-machine interface.

Reference numeral 16 denotes a multiplexing / demultiplexing unit, which is an audio signal from the audio encoding / decoding unit 5, a video signal from the video encoding / decoding unit 10, and a data interface unit in accordance with CCITT Recommendation "H.221". 13 data, data from the system controller 15 and CCITT Recommendation “H.2.
21 "," H.242 ", etc. are multiplexed for each transmission frame, and the reception frame is separated into each medium of a constituent unit, and the audio encoding / decoding unit 5 and the video encoding / decoding are performed. It notifies the unit 11, the data interface unit 13, the system control unit 15 and the like. 17 is IS
A line interface unit for controlling the line 19 according to the DN user / network interface. A storage unit 18 stores various control information.

FIG. 2 is a block diagram showing the flow from the analog input / output unit of the audio information / video information to the multiplexing / demultiplexing unit of the multimedia communication apparatus according to this embodiment. In the figure, 101 is an analog audio interface (I / F) unit that controls an analog audio signal input to this device and an analog audio signal output from this device, and 102 converts an input analog audio signal into a digital audio signal. First
An A / D conversion unit, 103 is a voice encoding unit that encodes the voice signal digitized by the first A / D conversion unit 102,
Reference numeral 104 denotes a first unit for converting a digital audio signal decoded by an audio decoding unit 105 described later into an analog audio signal.
A D / A conversion unit 105 is an audio decoding unit that decodes a received encoded audio signal, and 106 is an analog video interface (I) that controls an analog video signal input to this device and an analog video signal output from this device. / F) section, 107
Is a second A / D conversion unit for converting the input analog video signal into a digital video signal, 108 is a video coding unit for coding the video signal digitized by the second A / D conversion unit 107, and 109 is a video decoding described later. A second D / A conversion unit that converts the digital video signal decoded by the conversion unit 110 into an analog video signal, and 110 is a video decoding unit that decodes the received encoded video signal.

Reference numeral 111 indicates that the system control unit 15 of FIG. 1 multiplexes the voice coded signal from the voice coding unit 103 and the video coded signal from the video coding unit 108 to the line interface unit 17 of FIG. A multiplexer to transmit,
Reference numeral 112 denotes a separation unit that separates the received signal from the line interface unit 17 in FIG. 1 and transfers the audio signal to the audio decoding unit 105 and the video signal to the video decoding unit 110, and 113.
Is a digital recording section that is composed of a magneto-optical disk / HD (hard disk) and can digitally store video and audio signals, and 114 is an audio interface using an analog I / F such as a VTR.
An analog storage unit that can input video signals in synchronization and, conversely, can synchronously store the audio and video signals output by the analog I / F. 115 is a composite of various digital video signals. It is a digital video processing unit for editing. Reference numeral 116 denotes a first frame memory controlled by the digital video processing unit 115 to control the output from the second A / D conversion unit 107 and the output to the video encoding unit 108.
A second frame memory 17 is controlled by the video decoding unit 115.

3, the video coding unit 108 and the video decoding unit 110 of FIG. 2 are CCITT recommendation "H.261".
FIG. 2 is a block diagram showing an internal configuration in the case of conformity, in which 201 is an information source encoder that performs an encoding process of an input digital video signal of motion compensation interframe prediction + DCT + quantization, and 202 is a frame / GOB / MB.・ Block 4
A video signal multiplex encoder that performs a multiplex process using variable length coding according to a hierarchical structure of layers, 203 is a transmission buffer that temporarily stores the output signal from the video signal multiplex encoder 202, and 204 is a BCH. (511,493)
A transmission encoder that performs an encoding process using an error correction encoded frame, 205 is an encoding control unit that controls the entire video encoding unit 108, and 206 is the video encoding unit 108 in FIG.
, An information source decoder for decoding the reception code from 207, a video signal multiplexing decoder 207, a reception buffer 208 for temporarily accumulating the output signal from the transmission decoder 209, 209
Is a transmission decoder.

The operation of the multimedia communication apparatus having the above configuration will be described below in detail with reference to the flowchart of FIG.

First, when the operation section 14 of FIG. 1 is instructed to create an answering machine reply message, the optimum voice coding mode used for creating the reply message in step S401 in terms of both compression efficiency and reproduction sound quality. Is determined (selected). For example, original mode 8Kbps / 16K
bpsLD-CELP, PCM A-law, μ-la
Assuming that each mode of w is supported, the unique mode of 8 Kbps is most effective if only considering the compression efficiency.
16 Kbps LD-CELP is selected if there is a problem such as reproduction sound quality, especially when the PCM is performed after decoding and is extremely bad.

Next, in step S402, the video coding mode at the time of video coding and the maximum assignable transfer rate (maximum transfer rate) are selected. For example, CIF and QCI
If it has F and, select CIF. When the maximum transfer rate is 2B and the audio mode is PCM only, the maximum value when transmitting simultaneously with audio is 68.8 Kbps or the maximum rate when only video is 128 Kbps / 1.
Select 24.8 Kbps. Then step S403
2 based on the selection made in step S402 above.
A clock is input to each of the coding units 103 and 108 to start. This is possible by activating the multiplexing unit 111 in FIG. 2 in a pseudo manner. Of course, a completely different clock generator may be used.

Next, in step S404, the maximum time of the response message is displayed on the display unit 9 of FIG. 1 to notify the user, and if necessary, it is changed by an input from the operation unit 14 of FIG. Next, proceeding to step S405, the audio and video files for the response message are opened and various attributes are recorded (stored). Then step S
A display unit 9 of FIG. 1 or a handset 1, a speaker 3, or the like is used by 406 to notify the user of the start of response message creation, and in some cases, the operation unit 14 by the user.
Wait for instructions from.

When the creation of the response message starts, the process proceeds to step S407 and the output of the video multiplex encoder 202 shown in FIG. 3 in the video encoding unit 108 of FIG. 2 is monitored to encode the beginning of the frame, specifically, Wait for detection of "frame start code". If the "frame start code" is detected,
In step S408, the user is notified of the start of storage by using the display unit 9 of FIG. 1, the handset 1, the speaker 3, or the like.

Next, in step S409, the audio information is the output from the audio encoding unit 103 of FIG. 2 to the digital storage unit 113, and the video information is the video encoding unit 108 of FIG.
The process of transferring and accumulating the output from the video signal multiplex encoder 202 shown in FIG. 3 therein to the digital storage unit 113 of FIG. 2 from the head of the frame detected in step S407 is started. Next, the process proceeds to step S411, and it is monitored whether there is a time-out of the maximum time for creating the response message started in step S403 or an instruction to end the creation of the response message. If either one is detected, the process proceeds to step S412. After the file closing process of the response message is performed, this processing operation is ended.

[Second Embodiment] Next, the operation of the multimedia communication apparatus according to the second embodiment of the present invention will be described in detail with reference to the flowchart of FIG. In addition, the basic configuration of the multimedia communication device in the present embodiment is the
Since it is the same as FIGS. 1 to 3 of the embodiment, description will be given by diverting these FIGS. 1 to 3.

First, when an incoming call is received in step S501 of FIG. 5, it is judged whether or not it is in the recorded message mode, and if it is not in the recorded message mode, this processing operation is terminated without doing anything. Further, in the answering machine mode, the process proceeds to step S502 to automatically set up a call, that is, establish a first connection, and CCITT recommendations “H.221” and “H.221” are performed on the in-channel.
242 ”, frame synchronization establishment, capability information exchange sequence by BAS code, and mode switching sequence are executed. Next, in step S503, it is determined whether or not there is a request for additional connection setting, and if there is a request, the process advances to step S504 to establish an additional connection, establish frame synchronization on the additional connection, establish multiframe synchronization, and first channel. After establishing synchronization with
Proceed to 505. If there is no request for additional connection setting in step S503, then step S5
04 is skipped and it progresses to step S505.

In step S505, the audio coding mode / video coding mode for transmission is determined based on the result of the capability information exchange sequence, the mode switching sequence is executed, and the response message is selected. Next, step S506.
2 in the case where the accumulated voice encoding mode and the transmission voice encoding mode of the selection response message are different from each other,
Digital storage unit 113 → voice decoding unit 105 → path of multiplexing unit 111, or digital storage unit 113 → voice decoding unit 105 → first D / A conversion unit 104 → first A / D conversion unit 102 → voice code Any one of the paths from the conversion unit 103 to the multiplexing unit 111 is set.

Next, in step S507, the digital storage unit 1 shown in FIG. 2 is used as a transmission path of the video response message.
13 → video decoding unit 110 → digital video processing unit 1
15 → (second frame memory 117 and first frame memory 116) → video encoding unit 108 → multiplexing unit 111
Set the path of. More specifically, the digital storage unit 113 of FIG. 2 → the video signal multiplex decoder 207 of FIG. 3 → the information source decoder 206 → the digital video processing unit 115 → (the second
Frame memory 117 → first frame memory 116) →
Information source encoder 206 → video signal multiplex encoder 202 →
The transmission buffer 203 → transmission encoder 204 → the path of the multiplexing unit 111 in FIG. 2 is set. Next, the process advances to step S508 to wait for the end of transmission of the response message. Then, when the response message is transmitted, the process proceeds to step S509, the normal reception path is set again, the message is received, the received message is recorded, and then this processing operation is ended.

[Other Embodiments] In each of the above-described embodiments, only the case where the accumulated video encoded information is decoded and then re-encoded and transmitted is described for simplification of description. The input is not limited to this, and may be directly input to the multiplexing unit 111 in FIG.

Further, the video coding information is not directly extracted from the video coding unit 108 of FIG. 2, but the multiplexing unit 111 of FIG.
From the video decoding unit 110 to the demultiplexing unit 112, and the video signal multiplexing decoder 207 shown in FIG.
It is also possible to take out more.

[0044]

As described above, according to the present invention, according to the present onset Akira,
Since the response message in the answering machine mode can be digitally stored in the recording unit in a coded form in synchronization with the audio information and the video information, it can be stored with a significantly small storage capacity and dynamic access and reproduction can be performed. It will be possible.

[0045]

[0046]

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a multimedia communication device according to an embodiment of the present invention.

FIG. 2 is a block diagram showing a flow from an analog input / output unit of audio information / video information to a multiplexing / demultiplexing unit of the multimedia communication apparatus according to the embodiment.

3 is a block diagram of the video encoding unit and the video decoding unit of FIG.
It is a block diagram which shows an internal structure in case of a CITT recommendation "H.261" conformity.

FIG. 4 is a flowchart showing an operation of the multimedia communication device according to the embodiment.

FIG. 5 is a flowchart showing an operation of the multimedia communication device according to the second exemplary embodiment of the present invention.

6 is a frame configuration diagram shown in CCITT Recommendation “H.221”.

7: FA shown in CCITT Recommendation “H.221”
It is a bit allocation diagram in the multi-frame of S · BAS.

FIG. 8 is a flowchart showing a basic connection sequence in the conventional CCITT “H series recommendation” compliant video telephone device / video conference system.

[Explanation of symbols]

5 audio encoding / decoding section (audio encoding / decoding means) 11 video encoding / decoding section (video encoding / decoding means) 15 system control section (answer recording control means, first to third recording) Control means, first and second input control means, decoding, synchronization control means, decoding control means) 16 multiplexing / demultiplexing section 18 recording section (recording section) 106 analog storage section (recording section) 111 multiplexing section (Multiplexing means) 112 Separating section (Separating means) 113 Digital storage section (Recording section) 201 Information source encoder (encoding means) 202 Video signal multiplexing encoder (multiplexing means) 206 Information source decoder ( Decoding means) 207 Video signal multiplexing decoder (multiplexing means)

Claims (2)

(57) [Claims] 1. Audio encoding / decoding means for encoding audio information and for decoding the encoded audio information,
Video encoding / decoding means for encoding video information and decoding the encoded video information, audio encoding / decoding means, and audio encoded by the video encoding / decoding means A multiplexing means for multiplexing multimedia information such as information and video information and data; and a demultiplexing means for demultiplexing the multimedia information multiplexed by the multiplexing means so that each medium can be decoded. In the multimedia communication device, it is possible to automatically accept the incoming call at the time of the absence of the absence and to start the transmission of the voice information and the video information for the response message recorded in the recording unit in advance to enter the absence recording mode. after notifying the remote terminal, a recorded message control means for controlling to record the received audio information and video information, etc. from the partner terminal to the recording unit, the message recording mode Definitive the audio information and video information for the response message in advance a recording control means for recording in the recording unit, the audio information and video information for the reply message at the time of recording in the recording unit, the voice information wherein and said video information output of the voice encoding / decoding means controls to record in the recording unit as the information in the form of the output encoded in the video encoding / decoding means, and the
In addition, the video information for the response message includes the multimedia information.
Depending on the maximum video transmission rate
Recording to control so that it is encoded and recorded in the recording unit
Control means and audio information / images for the response message recorded in the recording section.
When transmitting image information, the encoded audio information is directly
A first input control means for controlling the input to the multiplexing means.
And the voice information and video for the response message recorded in the recording section.
When transmitting image information, the encoded video information is
It is input to the video encoding / decoding means to be decoded and
Encoding according to the capability of the terminal
A multimedia communication device, comprising: a second input control means for controlling to input . 2. Encoding audio information and encoding the audio information
Voice encoding / decoding means for decoding the generated voice information ,
The video information is encoded and the encoded video information is
Video encoding / decoding means for decoding, and audio encoding
/ Decoding means and the video encoding / decoding means
Marshalled audio and video information and data, etc.
Multiplexing means for multiplexing multimedia information and the multiplexing means
Multi-media information multiplexed by stages for each media
It has a demultiplexing means that demultiplexes so that it can be decrypted for each
Multimedia that communicates with a multimedia communication device
A. In the communication method, when an incoming call is received when you are out,
Voice information for response message recorded in the recording unit in advance
・ Start sending video information to confirm that
After notifying the other party's terminal, the received voice information / video from the other party's terminal
Answering machine that controls to record image information in the recording unit
The control process and the voice information for the response message in the above recorded message mode.
Control to record information / video information in the recording unit in advance.
A recording control step, the voice for the response message
When recording information / video information in the recording unit, the audio information
Is the output of the audio encoding / decoding means and the video information.
Information encoded output of the video encoding / decoding means
It is controlled so that it is recorded in the recording section as shape information.
In addition, the video information for the response message includes the multimedia information.
Depending on the maximum video transmission rate
Recording to control so that it is encoded and recorded in the recording unit
Control process and audio information / video for the response message recorded in the recording unit
When transmitting image information, the encoded audio information is directly
A first input control engine for controlling input to the multiplexing means.
And the voice information and video for the response message recorded in the recording unit.
When transmitting image information, the encoded video information is
It is input to the video encoding / decoding means to be decoded and
Encoding according to the capability of the terminal
A second input control step of controlling to input
A multimedia communication method characterized by the above.