JPH05276194A - Stored dynamic image reproduction control processing method - Google Patents

Abstract

PURPOSE:To provide a good conversational service without displaying the disturbance of picture by releasing the freezing of decoded picture screen at the side of storing and reading pictures when the stored picture information reading stop request is received or at the end of data reading picture message. CONSTITUTION:At the side of a dynamic image television telephone 401, a multiplexing section 409 detects a picture freezing request, sending a picture freezing direction to a picture encoding/decoding section 408. In this case, a television telephone 401 releases the freezing of picture automatically in the lapse of the constant time, a multiplexing section 412 of a center 402 repeatedly sends a picture freezing request at the shorter intervals than the automatic release at the television telephone 401. Thus, the picture, at the time of interrupting the reproduction of the stored dynamic image at the dynamic image television telephone or at the time of the reproduction end of the stored dynamic image message, is kept maintained, resulting in preventing the disturbance of screen.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention compresses the amount of information of a moving image, stores it, and then stores it in an image message storing and switching system using a center-to-end communication form for decoding and reproducing. The present invention relates to a moving image reproduction control processing method.

[0002]

2. Description of the Related Art FIG. 6 shows a system configuration of a conventional center-to-end still image-based image storage service.
FIG. 7 shows the system configuration of the moving picture video phone, and FIG. 8 shows the image transmission method used in the moving picture video phone.

In FIG. 6, a center 103 and a terminal 101 are connected via a communication network 102. A communication path is established through the communication network in response to a connection request from the terminal or the host 110 in the center. When the communication path is established, the data of the guide screen of the still image is transferred from the center to the terminal and is displayed on the monitor 106 of the terminal, and the user on the terminal side selects a menu along the guide screen. When the image accumulation is selected, the image from the camera 105 and the sound from the handset 107 are respectively supplied to the image encoding / decoding unit 10.
8. The host 1 is stored in the storage device 104 of the center 103 via the communication channel after being encoded by the voice encoding / decoding unit 109.
It is stored under the control of 10. When the reproduction is selected, the encoded image / sound data stored in the storage device 104 of the center is read out, and the image encoding / decoding unit 108 and the sound encoding / decoding unit 109 of the terminal are read via the communication path. The image data and audio data are decoded by and the still image is displayed on the monitor.
Sound is output to the handset. Here, since the image is encoded on a frame-by-frame basis based on the still image, even if the reading of the stored coded image audio data is interrupted midway or when the reading is completed, the terminal Image distortion on the side does not occur.

On the other hand, the operation of the moving picture videophone is as follows. In FIG. 7, the camera 204 of the local terminal 201
The image input from a is an image encoding / decoding unit 208a.
Encoding by inter-frame predictive encoding by the multiplexing unit 20.
9a is input. The voice signal input from the handset 206a is encoded by the voice encoding / decoding unit 210a and input to the multiplexing unit 209a. Multiplexer 209a
Then, under the control of the control unit 207a, the coded image data, the coded audio data, and the control data for the image instructed by the control unit 207a (hereinafter referred to as image control data) are multiplexed together. , To the other terminal 202 via the communication network 203.

The multiplexed data sent from the local terminal 201 is received by the multiplexing unit 209b and separated into image control information, coded image data and coded audio data. The image control information is transferred to the control unit 207b, the encoded image data is transferred to the image encoding / decoding unit 208b, and the encoded audio data is transferred to the audio encoding / decoding unit 210b. The image encoding / decoding unit 208b decodes the encoded image data that has been subjected to interframe predictive encoding, is reproduced and output to the monitor 205b, and the encoded audio data is the audio encoding / decoding unit 21.
It is decrypted with 0b and output to the handset 206b. The image control information is processed by the control unit 207b.

Next, a method of transmitting a moving image will be described with reference to FIG. After the connection of the line is established, the control unit 207a of the own terminal 201 uses the above-mentioned image control information to send an "update screen transmission request" to the other terminal 202 as a reference screen for inter-frame prediction. put out. Upon receiving this information, the control unit 207b of the partner terminal issues a "screen update instruction" to the image encoding / decoding unit 208b,
The image encoding / decoding unit 208b of the partner terminal 202 sends the “update screen data” to the own terminal 201.
With such a procedure, a good image can be viewed on the local terminal 201 at the earliest timing after the line connection.

When the reproduced image is disturbed due to a scene change of the input image or the like, a "transmission screen freeze request" is transmitted using the control information for the image of the partner terminal 202,
During the disturbance, the playback image of the local terminal 201 is frozen,
The freeze is released when the reproduced image becomes clear to some extent.

When the moving picture video telephone adopting the inter-frame predictive coding shown in FIGS. 7 and 8 is applied to the system shown in FIG. 6, the accumulated moving image accumulated in the center is being reproduced. After the interruption or the reproduction of the accumulated moving image is finished, the screen is disturbed and the conversation quality is expected to be deteriorated.

[0009]

When it is attempted to realize an image storage service using a moving image adopting an inter-frame predictive coding method, reproduction control of the accumulated moving image (for example, interruption / restart of reproduction of the accumulated moving image) is performed. Alternatively, it is important not to display the image distortion when the next moving picture message is read out after the reproduction of one moving picture message is finished).

An object of the present invention is to provide a conversation service of high quality so as not to display image disturbance.

[0011]

According to the present invention, encoding means for encoding an input image and first transmission for multiplexing the encoded image with encoded voice, control data, etc. Means, first receiving means for receiving the multiplexed data and separating the coded image, coded voice, control data, etc., and means for decoding the received coded image,
A terminal provided with an encoding means, a decoding means, a first transmission means, and a first control means for controlling the first reception means, and a second for receiving an image transmitted from the first transmission means. Receiving means, a storage means for storing the coded images and sounds received by the second receiving means, a reading means for reading the stored coded images and sounds, and a read and coded A center provided with a second transmission means for transmitting images and sounds and a second control means for controlling the storage means and the reading means, and the terminal and the center were connected via a communication network In a center-to-end type image message storage / exchange system, when reading stored images, the storage reading side of images is triggered by the reception of a reading stop request from the terminal user or the end of the reading data of the image message. Back And to perform the freezing control of the image screen.

[0012]

By using the stored moving image reproduction control processing method, it is possible to control the reproduction of the accumulated moving image without causing the image display disturbance of the moving image data even if the moving image encoding / communication method is used. ..

[0013]

EXAMPLES Examples of the present invention will be described in detail below. FIG. 1 shows a system configuration of a stored moving image reproduction control processing method according to the present invention. CCITT Recommendation H.264. 2 shows the frame structure of 221, the moving image storage method in FIG. 3, the stored packet format in FIG. 4, and the moving image playback method in FIG.

In FIG. 1, 401 is a moving picture videophone,
Reference numeral 402 is a center and 403 is a communication network. The video / video phone 401 includes a camera 404, a monitor 405, a handset 406, a control unit 407, and an image encoding / decoding unit 40.
8, a voice encoding / decoding unit 410, and a multiplexing unit 409. The center 402 includes a control unit 411, a multiplexing unit 412, and a storage device 413.

In FIG. 2, 501 is a CCITT recommendation H.264 which is assembled by the multiplexers 409 and 412. 221 is a frame structure compliant with 221, and 502 is a frame synchronization signal (FA
S) and 503 are bit rate allocation signals (BAS), which are used for negotiation of terminal capability and communication conditions. Reference numeral 504 is data in which encoded image data, encoded voice data, and general data are multiplexed, and 505 is a frame configuration when two ISDN basic interfaces are used.

The operation of the embodiment will be described below. Figure 1
In, the basic operation of the moving picture message storage and exchange system using a moving picture videophone will be described. After the connection is established from the moving picture videophone 401 to the center 402 via the communication network 403 and the communication path is established, the BA shown in FIG. 2 is set by the control section 407 in the moving picture videophone and the control section 411 in the center.
Image communication to the center 402 is performed according to an instruction from the control unit 407 according to the result of the capability exchange of the terminal using S503.

That is, the camera 404 on the videophone 401 side
The moving image from is subjected to interframe predictive coding by the image coding / decoding unit 408. The encoded image data is input from the handset 406, is multiplexed by the multiplexing unit 409 together with the encoded voice data encoded by the voice encoding / decoding unit 410 and the image control information from the control unit 407, and is transmitted. It is transmitted to the multiplexing unit 412 in the center 402 via the network 403.

On the center side, the data in which the image, voice, image control information and the like received by the multiplexing unit 412 are multiplexed is instructed by the control unit 411 and the frame structure 50 shown in FIG.
1 or 505 as it is as an appropriate file,
It is stored in the storage device 413.

The stored data is read from the storage device 413 according to an instruction from the control unit 411 that has received a request from the user of the video-telephony, and the multiplexing unit 41 in the center.
2 is transferred. The control unit 411 rewrites the image control information accumulated from the moving picture video telephone 401 as it is at the time of storage into new information if necessary, and transmits it to the moving picture video telephone 401 through the communication network 403.

In the moving picture videophone 401, the data in which the image, voice, image control information, etc. sent from the center are multiplexed is separated by the multiplexing unit 409 into encoded image data, encoded voice data, and image control information. The encoded image data is transferred to the image encoding / decoding unit 408, the encoded audio data is transferred to the audio encoding / decoding unit 410, and the image control information is transferred to the control unit 407. Encoded image data is image encoded
The decoding unit 408 decodes and reproduces the moving image according to the instruction from the control unit 407 and displays it on the monitor 405. The encoded audio data is decoded by the audio encoding / decoding unit 410,
Playback is performed and output from the handset 406. In this way, you can store messages from video-phones in the center, search stored messages,
Can be read.

Next, the operation of the basic part of the present invention will be described in detail. FIG. 3 shows a moving image storage method. In the figure, an example will be described in which communication is already possible between the video videophone 401 and the center 402, and messages from the videovideophone 401 are accumulated by voice / image.

On the moving picture videophone side, the control unit 407 sends a "storage start request" of an image to the multiplexing unit 409.
Instruct to transmit using S. In the center 402, the multiplexing unit 412 receives the “storage start request” by the BAS, and notifies the control unit 411 of the content. Control unit 41
In step 1, an “accumulation start instruction” is issued to the multiplexing unit 412. The multiplexing unit 412 sends a “screen update request”, which is a reference screen for inter-frame prediction, to the control unit 40 of the video / videophone 401.
7 is notified using BAS. The control unit 407 gives a “screen update instruction” to the image encoding / decoding unit 408. The image encoding / decoding unit 408 displays “update screen data”
To the center 402.

The frame structure transmitted at this time is shown in FIG.
Take the configuration of. The image and audio data encoded by the image encoding / decoding unit 408 and the audio encoding / decoding unit 410 are instructed by the control unit 407 in accordance with the determination of capability exchange using the BAS (bit rate allocation signal) 503. By H.M.
It is set at a predetermined position 504 defined by 221. F
The AS (frame synchronization signal) 502 is created by the multiplexing unit 409, and the BAS 503 is set with the contents instructed by the control unit 407 (for example, terminal capability exchange information, conversation command between the center and the terminal, etc.).

The multiplexing unit 412 in the center 402 receives the moving image message starting with the update screen having the frame structure shown in FIG. 2, assembles it into the storage packet shown in FIG. 4, and sequentially stores it in the storage device 413. By doing so, it is possible to always store the moving image message starting with the update screen which is the reference screen for inter-frame prediction. It should be noted that the accumulated packet in FIG. 4 is provided with continuous identification such as head, middle, last, and single. As a result, the beginning and end of the packet forming the message can be recognized.

FIG. 5 shows a method of reproducing the accumulated moving image. The control unit 407 that has received the request from the video-phone user
Storage data is read from the storage device 413, and the frame structure 505 or the frame structure 501 is transferred as "read data" to the multiplexing unit 412 as it is. The multiplexing unit 412 transmits the frame configuration to the videophone 401. In the video / video telephone 401, the multiplexing unit 409 separates frame data, the BAS content is notified to the control unit 407 as image control information, and the image coded data is image coded.
It is sent to the decoding unit 408, and the interframe prediction code is decoded.

When the moving picture videophone user requests the reproduction data to be interrupted, the control section 411 on the center 402 side stops the reproduction data transmission and sends a "transmission screen freeze request" to the multiplexing section 412. To do. Multiplexer 41
2 transmits a “screen freezing request” to the video / video phone 401, and causes the image encoding / decoding unit 408 to freeze the screen. At this time, the screen freeze is performed in consideration of a transmission error or the like, so that the screen freeze is automatically released after a certain period of time on the moving picture videophone 401 side. Therefore, the control unit 411 of the center 402 repeatedly sends a "screen freeze request" to the multiplexing unit 412 at a time interval shorter than the time automatically released on the video-videophone 401 side.

After that, when the moving picture videophone user sends a "reading restart request" to the control section 411 of the center, the reproduction data is transmitted from the multiplexing section 412 to the moving picture videophone side. Here, considering the frame synchronization establishment time between the video-phone and the center and the image pull-in time due to the restart data not starting from the update screen,
During that time, the screen freeze is repeatedly transmitted. In this way, the transfer is continuously performed while the continuous identification of the accumulated packet is in the middle, and when the “continuous identification is final”, the multiplexing unit 412 sets the screen freeze request to BAS and sets the moving image videophone side. Send to 401.

On the side of the moving picture videophone 401, the multiplexing unit 4
09 detects a “screen freeze request” and issues a screen freeze instruction to the image encoding / decoding unit 408. At this time, the freezing of the screen is automatically canceled on the side of the moving picture videophone 401 after a certain period of time. Therefore, the multiplexing unit 412 of the center 402.
Repeatedly sends the “image freezing request” at a time interval shorter than the time automatically released on the side of the videophone 401. In this way, the screen at the time of interruption of the reproduction of the accumulated moving image or the end of the reproduction of the accumulated moving image message on the side of the moving picture videophone remains held, and the disturbance of the screen can be prevented.

[0029]

As described above, according to the present invention,
Even when a moving picture videophone is used, reproduction control of stored images can be performed without causing screen disturbance, and a high-quality stored conversation service can be realized.

[Brief description of drawings]

FIG. 1 shows a system configuration of a stored moving image reproduction control processing method of the present invention.

FIG. 2 shows a stored image frame structure according to the present invention.

FIG. 3 shows a moving image storage method of the present invention.

FIG. 4 shows a stored packet.

FIG. 5 shows a method of reproducing a stored moving image.

FIG. 6 shows a system configuration of a conventional image storage service based on still images.

FIG. 7 shows a system configuration of a conventional moving image videophone.

FIG. 8 shows an image transmission method used in a conventional moving image videophone.

[Explanation of symbols]

 401 Video / Videophone 402 Center 403 Communication Network 404 Camera 405 Monitor 406 Handset 407 Control Unit 408 Image Encoding / Decoding Unit 409 Multiplexing Unit 410 Voice Encoding / Decoding Unit 411 Control Unit 412 Multiplexing Unit 413 Storage Device

Claims (1)

[Claims] 1. A coding means for coding an inputted image, a first transmitting means for multiplexing the coded image with coded voice and control data and transmitting the multiplexed data, and a means for receiving the multiplexed data. First receiving means for separating into a coded image, a coded voice and control data, a means for decoding the received coded image, a coding means, a decoding means and a first transmitting means. A second receiving means for receiving an image transmitted from the first transmitting means, and a second receiving means for receiving the image, the terminal having a first control means for controlling the first receiving means. Storage means for accumulating the coded image and sound that have been read, reading means for reading the coded image and sound that have been stored, and a second means for transmitting the read coded image and sound. Controls sending means, storage means and reading means In a center-to-end type image message storage / exchange system, in which the terminal and the center are connected via a communication network, a terminal user of the terminal user reads the stored image. A stored moving image reproduction control processing method characterized in that the decoded image screen freeze control is performed on the image reading side upon reception of a read stop request or the end of read data of the image message. ..