JPH08265680A - Communication terminal equipment - Google Patents

Abstract

PURPOSE: To improve the image quality of the video recording video in a communication terminal equipment. CONSTITUTION: In the communication terminal equipment which is provided with a video storage means 104 and is made to perform the communication by video, a video recording means 103 performing the video recording of the inputted original video before a coding is performed in a video storage means 104 and a reproduction means 105 reproducing the video before the coding for which the video recording is performed by the video storage means 104 are provided, and the video recording of the high image, quality video before the coding for communication is performed is made possible.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a communication terminal device,
In particular, it is suitable for use in a communication terminal device that transmits and receives moving images / still images in ISDN.

[0002]

2. Description of the Related Art In recent years, advances in communication technology
In particular, as a result of an increase in the amount of transfer data (data transfer rate) per unit time, a terminal device has been proposed which uses a moving image or a still image (hereinafter, both are referred to as “video”) for communication. .

Communication using such images is standardized by the ITU, and ITU-T Recommendation H.264 is applied to all terminal devices. In ITU-T Recommendation H.320, the demultiplexing of a plurality of media such as video, audio, and data and the frame structure thereof are described in H.320. 221 of the ITU-T Recommendation H.221. 261 respectively.

FIG. 3 shows ITU-T Recommendation H.264. 221 of H.221. 221 shows the structure of a 221 frame. In FIG. 3, reference numeral 200 denotes H.264. 221 frames and 201 are H.264 frames between the transmitting and receiving video conference terminals. It is an FAS (frame synchronization signal) for establishing frame synchronization of the 221 frame 200.

Reference numeral 202 denotes a BAS (bit rate assignment signal) for exchanging the communication capability and communication mode of the video conference terminal, and 203 denotes audio for a multipoint video conference.
This is a 24 kbps audio slot for transferring the voice of the video conference terminal of the own station and / or the voice of the video conference terminal of another station.

Reference numeral 204 denotes an 8 kbps data slot for transferring conference data such as diagrams, tables and pointing information for multipoint video conference. 205
Is a video slot of 30.4 kbps, and is for transferring the video of the video conference terminal of its own station and / or the video of the video conference terminal of another station as the video for the multipoint video conference.

Here, the voice slot 2 shown in FIG.
03, the data slot 204, and the video slot 205 are examples, and the bit rate allocation signal BAS2
By exchanging communication modes according to 02, it is possible to actually select various combinations of slot widths according to the amount of information to be transferred.

In addition, the above H. The structure of the 221 frame 200 is an example when one B channel of ISDN is used, and when two B channels are used, each B channel is used as the first channel and the additional channel, and the above-mentioned is used on both channels. H. By transferring the 221 frame 200, it is possible to transfer information at a maximum of 128 kbps.

Regarding the image, the above H. It is transmitted and received in the video slot 205 in the 221 frame 200. The flow of the video data at this time will be briefly described with reference to FIG. In FIG. 8, 300 is an ISDN line (and exchange), and 301 and 311 are communication terminal devices.

Reference numerals 302 and 312 denote a line interface unit for controlling an ISDN line, 303 a video encoding unit, 313 a video decoding unit, and ITU-T Recommendation H.264.
This is for performing the encoding processing of the transmission image and the decoding processing of the reception image according to the image encoding / decoding algorithm defined by H.261.

Reference numerals 304 and 314 denote video input / output units, which are image input / output means such as a CRT monitor, a person camera,
It has a document camera and the like, and is for performing analog / digital conversion and digital / analog conversion processing of image signals. Reference numerals 305 and 315 denote video storage memories for storing video.

Next, consider a case where an image input to one communication terminal device 301 is transmitted to the other communication terminal device 302. In one communication terminal device 301, the video input through the video input / output unit 304 is input to the video coding unit 303 as a video of an analog signal (analog video) and is recommended by H.264. The video coded according to Recommendation H.261 is coded according to H.26.
It is called one video. ), And H. The 261 video is transmitted to the line through the line interface unit 302.

The other communication terminal device 311 receives the H.264 signal received from the line interface unit 312. The 261 video is decoded into an analog video by the video decoding unit 313, and the decoded video is output from the video input / output unit 314.

When performing such communication, it is conceivable to record the video received by the other communication terminal device 311. In that case, as shown in FIG. 9, the video decoding unit 31
The analog video decoded in 3 is branched by the video input / output unit 314 and recorded in the video storage memory 315. Alternatively, the video input / output unit 314 digitizes the digital video into a video storage memory 315.
I am trying to record it.

In the above-mentioned conventional example, the conventional example in the recommended H series compliant system is shown. However, even when the system does not comply with the recommended H series, the flow of the video data is as follows: The other configurations are the same, only the encoding method of 313 is different.

[0016]

[Problems to be Solved by the Invention] However, the above recommendation H. In the coding method defined in H.261 (and similar coding methods), since the emphasis is placed on transferring video in real time, the transfer data has a relatively low bit rate. Therefore, the decoded video has a drawback that it is more deteriorated than the original video.

Therefore, conventionally, when recording the received video, the video decoded by the video decoding unit 313 is recorded, so that there is a problem in that the image quality is severely deteriorated. In view of the above problems, it is an object of the present invention to improve the image quality of recorded video in a communication terminal device.

[0018]

A communication terminal device of the present invention is provided with video storage means, and in a communication terminal device adapted to perform video communication, the input original video before encoding is described above. The recording means for recording in the image storage means and the reproduction means for reproducing the input original image before encoding recorded in the image storage means.

Another feature of the present invention is that
A recording instruction means for instructing a communication partner terminal device to record the input original video before encoding in the video storage means is provided.

Another feature of the present invention is that
It is characterized in that a recording video transfer means for transferring the input original video reproduced by the reproducing means is provided to a communication partner terminal device instructed to record the input original video.

Another feature of the present invention is that a recording video transfer instruction means for instructing the other terminal device of the communication to transfer the recording video to activate the recording video transfer means is provided. Is characterized by.

Another feature of the present invention is that the input original video is digitized and then recorded in the video storage means.

Another feature of the present invention is that the input original image is recorded in the image accumulating means as it is as an analog signal and is read from the image accumulating means when it is transmitted to a communication partner terminal device. I am trying to digitize it.

[0024]

Since the present invention has the above technical means, the input original video before encoding can be recorded in the video storage means, and the input original video before encoding recorded in the video storage means can be reproduced. As a result, it becomes possible to record a high quality image on the communication terminal device.

Further, according to another feature of the present invention, it becomes possible to instruct the communication partner terminal device to record the input original image before the encoding for communication is performed. A high-quality image can be recorded on a communication partner terminal device.

According to another feature of the present invention, it is possible to transfer the image reproduced by the reproducing means.
It is possible to give an instruction from the terminal device side of the communication partner.

Further, according to another feature of the present invention, it is possible to activate the recorded image transfer means by instructing the other terminal device of communication to transfer the recorded image.

[0028]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of a communication terminal device of the present invention will be described below with reference to the drawings. FIG. 1 is a functional configuration diagram of a communication terminal device showing an embodiment of the present invention. As shown in Figure 1,
The communication terminal device of this embodiment includes a video input unit 100, a video encoding unit 101, a line interface 102, a recording unit 103, a video storage unit 104, a reproduction unit 105, a recorded video transfer unit 106, a recording instruction unit 107, and a recorded video. A transfer instruction means 108 and a system control means 109 are provided.

The image input means 100 has a CRT monitor, a person camera and a document camera, and performs analog / digital conversion processing of the input original image S1. The video encoding means 101 converts the input original video S1 input via the video input means 100 into the recommended H.264 standard. It is encoded by the encoding method defined by H.261.

The line interface 102 is for transmitting the video coded by the video coding means 101 to a communication partner terminal device, and is used by an ISDN user.
The line is controlled according to the network interface.

The recording means 103 is for recording the input original video S1 before encoding in the video storage means 104. The image storage means 104 is for recording the input original image S1 before encoding, and includes a semiconductor memory,
A magnetic recording medium such as a magnetic tape, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a magneto-optical recording medium, or the like.

The reproducing means 105 is provided to reproduce the uncoded video recorded in the video storage means. The recorded image transferring means 106 is for transferring the image reproduced by the reproducing means to the communication partner terminal device instructed to record the input original image S1.

The recording instruction means 107 is for instructing a communication partner terminal device to record the input original image S1 before encoding in the image accumulation means. The recorded video transfer instructing means 108 is for instructing the partner terminal device of the communication to transfer the recorded video to activate the recorded video transferring means.

The system control means 109 is for controlling the overall operation of the communication terminal device of this embodiment, and for example, the above-mentioned recording means 103 and reproduction means 105.
The operation of is controlled by the instruction of the operator.

Next, a first embodiment showing a specific configuration of the communication terminal device of this embodiment will be described in detail with reference to the configuration diagram of FIG. In the first embodiment, as a communication terminal device, ISDN is used for the line, and H.264 is recommended for the coding method. 26
An ISDN videophone terminal device using 1 is assumed.

In FIG. 2, reference numeral 1 denotes a video input / output section which constitutes the video input means 100, and CR which is a video output means.
It has a T monitor, a person camera or a document camera as an image input means, and the like. It is also provided for performing analog / digital conversion and digital / analog conversion processing of the video signal.

2 is ITU-T Recommendation H.264. A video encoding / decoding unit that performs transmission video encoding processing and reception video decoding processing according to the video encoding / decoding algorithm assumed in H.261.

Reference numeral 3 denotes a system control unit, which internally has a CPU.
And has a ROM, a RAM, and creates a recording-related command by input from the operation unit 4, interprets a recording-related command received from the multiplexing / separating unit 6, and the like.
As a result, each part of the terminal device is controlled.

An operation unit 4 is used for inputting control information for controlling the communication terminal device of this embodiment and has an input device such as a keyboard, a tablet, a mouse. Reference numeral 5 is a video storage memory for recording video.

Reference numeral 6 denotes a demultiplexing unit, which is recommended by ITU-T Recommendation H.264. 221, various data signals such as commands relating to recording from the system control unit 3 and the video encoding / decoding unit 2
A multiplexing process is performed to multiplex the video signal from the audio signal and the audio signal from the audio encoding / decoding unit in transmission frame units according to the current communication capability and communication mode.

Further, the received frame is separated into each medium of a constituent unit, and a separation process for notifying to the system control unit 3, the video encoding / decoding unit 9 and the audio encoding / decoding unit is performed. A line interface unit 7 is connected to the ISDN line,
It is for controlling the line according to the network interface.

The operation procedure of the communication terminal device of the first embodiment will be described below. In the description of the present embodiment, as described before with reference to FIG. 8, a communication path has already been secured between the two communication terminal devices, and the H.264 standard has been established before the operation starts.
It is assumed that communication using 261 video is being performed. Further, although the communication between the communication terminal devices is bidirectionally transmitted and received, for convenience of explanation, a terminal device which inputs a video as a source of recorded video data is referred to as a “video transmission side terminal”, The other is referred to as a "video receiving terminal".

As an operation outline, a video recording-related command is transmitted from the video receiving side terminal, and the corresponding processing is performed in the video transmitting side terminal which has received the command. Also, there are three recording-related commands: a "recording start command", a "recording end command", and a "video transfer command".

6 and 7 are flowcharts showing the operation of the communication terminal device of the first embodiment. FIG. 6 shows the operation of the video receiving side terminal, and FIG. 7 shows the operation of the video transmitting side terminal. Is shown. First, the operation of the video receiving side terminal will be described. As shown in FIG. 6, step S101
At, the process waits for a user input from the operation unit 4. Then, when there is an input from the user, the input data is transmitted to the system control unit 3.

Next, in step S102, the system controller 3 analyzes the input from the user. There are three recording-related input operations, "recording start", "recording end", and "video transfer". When the above analysis result is applicable, the following steps S102 and S11 are performed.
0, the process of step S120 is performed.

That is, in step S103,
The system control unit 3 issues a recording start command corresponding to "recording start", and the multiplexing / separation unit 6 stores the command data as command data.
Communicate with. After that, the process proceeds to step S104, and the demultiplexing unit 6 sends the command data to the H.264 format. 221 frame 200
The data is allocated to the data slot 204, multiplexed, and transmitted from the line interface unit 7. Then, step S1
Return to 01.

On the other hand, in step S110, the system controller 3 issues a recording end command corresponding to "recording end", and the demultiplexer 6 transmits it as command data. Then, the process proceeds to step S111, where the demultiplexing unit 6 sends the command data to the H.264 format. It is assigned to the data slot 204 of the 221 frame 200, multiplexed, and transmitted from the line interface unit 7. After that, step S101
Return to.

In step S120, the system controller 3 issues a video transfer command corresponding to "video transfer", and the demultiplexer 6 transmits the command data as command data. After that, the process proceeds to step S121, and the demultiplexing unit 6 sends the command data to the H.264 format. It is assigned to the data slot 204 of the 221 frame 200, multiplexed, and transmitted from the line interface unit 7.

Next, in step S122, the recorded video data from the data slot 204 separated by the demultiplexing unit 6 is assembled by the system control unit 3 and recorded in the video storage memory 5 (see FIG. 5).

Next, the operation of the video transmission side terminal will be described with reference to FIG. First, in step S201, the data slot 20 separated by the demultiplexing unit 6
The data of No. 4 is analyzed by the system control unit 3, and a recording-related command is awaited. Then, when the recording-related command is received, the recording-related command is analyzed.

If the result of the analysis in step S201 is a recording start command, the process proceeds to step S202,
If it is a recording end command, the process proceeds to step S210, and if it is a video transfer command, the process proceeds to step S220.

When the process proceeds to step S202, the image input / output unit 1 branches the input image data according to an instruction from the system control unit 3, and the image encoding / decoding unit 2 operates normally.
At the same time, the input video data is digitized and recording in the video storage memory 5 is started. Then, the process returns to step S201 (see FIG. 5).

When the process proceeds to step S210, the recording of the input video data in the video storage memory 5 is completed by an instruction from the system control unit 3. After that, step S
Return to 201.

If step S220 is reached,
The system control unit 3 acquires the recorded video data from the video storage memory 5, and the demultiplexing unit 6 converts the data into H.264 data. 22
It is assigned to the data slot 204 of one frame 200, multiplexed, and transmitted from the line interface unit 7 (see FIG. 5).
reference).

Next, a second embodiment of the communication terminal device of the present invention will be described. In the second embodiment, the video input / output unit 1 branches the input video data in accordance with an instruction from the system control unit 3 in step S202 of FIG.
It is normally transmitted to the image encoding / decoding unit 2. And
At the same time, recording of the input video data as an analog signal in the video storage memory 5 is started. Then, it returns to step S201.

In step S220, the system control unit 3 acquires the recorded video data from the video storage memory 5 and digitizes it, and the demultiplexing unit 6 converts the data into H.264 format. 221 frame 200 audio slot 20
4 and multiplexes and transmits from the line interface unit 7.

As a result, a medium such as an analog video tape can be used as the video storage memory 5 in the video transmission side terminal. In addition, in the first embodiment, in transmitting the recording-related command and transferring the recorded video,
H. Although the data slot 204 of the 221 frame 200 is used, it is also possible to use the D channel packet.

[0058]

As described above, according to the present invention, the recording means for recording the input original image before encoding in the image accumulating means, and the reproducing means for reproducing the unencoded image recorded in the image accumulating means. Since the above is provided, it is possible to obtain an effect that it is possible to record, in the communication terminal device, a high-quality image before encoding for communication.

According to another feature of the present invention, the recording instruction means for instructing the communication partner terminal device to record the input original image in the image storage means before encoding the input original image is provided. It is possible to obtain the effect of being able to instruct a communication partner terminal device to record a high-quality video image.

Further, according to another feature of the present invention, since the recorded image transferring means for transferring the image reproduced by the reproducing means is provided, the image reproduced from the image accumulating means is transmitted to the communication terminal device. The effect that it can be transmitted is obtained.

Further, according to another feature of the present invention, since the recorded image transfer instruction means for instructing the other terminal device of the communication to transfer the recorded image and activating the recorded image transfer means is provided, There is an effect that it is possible to instruct the partner terminal device side of communication to transmit the video reproduced from the video storage means.

[Brief description of drawings]

FIG. 1 is a functional configuration diagram showing an outline of components of a communication terminal device of the present invention.

FIG. 2 is a block diagram showing a specific configuration of a communication terminal device according to the first example of the present invention.

FIG. 3 ITU-T Recommendation H.264. 221 of H.221. It is a figure which shows the structure of the 221 frame.

FIG. 4 is an explanatory diagram showing a flow of video data in the first embodiment.

FIG. 5 is an explanatory diagram showing a flow of video data in the first embodiment.

FIG. 6 is a flowchart showing a processing procedure of a video receiving side terminal device in the first embodiment.

FIG. 7 is a flowchart showing a processing procedure of the video transmission side terminal device in the first embodiment.

FIG. 8 is an explanatory diagram showing a flow of video data in a conventional video communication terminal device.

FIG. 9 is an explanatory diagram showing a flow of video data in a conventional video communication terminal device.

[Explanation of symbols]

 1 video input / output unit 2 video encoding / decoding unit 3 system control unit 4 operation unit 5 video storage memory 6 demultiplexing unit 7 line interface unit 100 video input unit 101 video encoding unit 102 line interface 103 recording unit 104 video Storage means 105 Playback means 106 Recorded video transfer means 107 Recording instruction means 108 Recorded video transfer instruction means 109 System control means S1 Input original video signal

Claims (6)

[Claims] 1. A communication terminal device comprising a video storage means for performing video communication, a recording means for recording an input original video before encoding in the video storage means, and the video. A communication terminal device, comprising: a reproduction unit that reproduces an input original video image that has not been encoded and that has been recorded in the storage unit. 2. The recording instructing means for instructing a partner terminal device of communication to record the input original image before encoding in the image accumulating means, according to claim 1. Communication terminal equipment. 3. The recorded image transfer means for transferring the image reproduced by the reproducing means is provided to a communication partner terminal device instructed to record the input original image. 2. The communication terminal device according to any one of 2. 4. A recorded image transfer instructing means for instructing a remote terminal device of the communication to transfer a recorded image and activating the recorded image transferring means, according to claim 1. 2. The communication terminal device according to item 1. 5. The communication terminal device according to claim 1, wherein the input original video is digitized and then recorded in the video storage means. 6. The input original video image is recorded in the video image storage means as an analog signal as it is, and is read out from the video image storage means and digitized when being transmitted to a communication partner terminal device. Claim 1 to
4. The communication terminal device according to any one of 4 above.