JP3266226B2 - Image storage device and stored image reproduction device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image storage and reproduction apparatus, and more particularly, to an image storage and reproduction apparatus transmitted from a terminal for communicating video information such as a TV telephone, and more particularly to an ITU (International Telecommunication Union). The present invention relates to an image communication system capable of storing multiplexed data of images, sounds, and various data compliant with -T recommendations and reproducing the stored data from any terminal.

[0002]

2. Description of the Related Art In recent years, in addition to conventional interactive communication services such as telephone and facsimile (facsimile), a storage service capable of storing voice information in a network center and reproducing it at any time. Is provided. Also, I
With the development of digital communication networks represented by SDN (Integrated Services Digital Network), for example, it has become possible to use image communication services represented by videophones. Against this background, demands for storage-type services using images have increased, and some of them have been put into practical use.

As a known document describing a conventional stored image reproducing apparatus, for example, Japanese Patent Application Laid-Open No. 62-188579
There is an official gazette. This publication uses a packet communication network for transmitting moving image information from a moving image information database,
Absorb the variation of transmission delay by the packet communication network,
A moving picture information storage / conversion device for converting the video signal into a video signal which is easy for the user to receive is provided, and the user takes out the stored moving picture information at a desired time.

Japanese Patent Application Laid-Open No. 3-132128 discloses a method in which image information and audio information composed of a still image / recording input by a user from a terminal are stored as a message in a center, and a request from the user is received. It is designed so that the corresponding message can be reproduced on the terminal as entered. Further, Japanese Patent Application Laid-Open No. 4-79655 discloses
A means for registering conditions for collecting information from an information collection user terminal having an input / output function of video and audio text information, and information having an input / output function of video and audio text information based on the registered information A call is made to the collection user terminal, the information is automatically received, and the collected information is stored based on the intention of the collection requestor.

FIG. 11 is a block diagram of a conventional multiplexed data transmission / reception unit. In the figure, 91 is a stored data extracting unit, 92 is a packet generating unit, 93 is a packet decomposing unit, 94 is a line data generating unit, 95 is a receiving unit of a multiplexed data transmitting / receiving unit, 9
Reference numeral 6 denotes a transmission unit of the multiplexed data transmission / reception unit. The stored data extracting unit 91 extracts multiplexed data to be stored from the received line multiplexed data according to an instruction from the system control unit. The packet generation unit 92 generates a packet from the stored multiplexed data received according to an instruction from the system control unit. The packet decomposing unit 93 extracts multiplexed data to be reproduced from packets output from the storage device. The line data generation unit 94 generates line multiplexed data from the multiplexed data output from the packet decomposing unit according to an instruction from the system control unit.

FIGS. 12 (a) and 12 (b) are diagrams showing a conventional data multiplexing format, and are diagrams showing a data multiplexing format currently used in videophones and the like. It has been adopted as an international standard, and by using this multiplexing method, interconnectivity for videophones and the like is ensured. In the figure,
Areas 101 and 102 are assigned to audio data and image data, respectively, 103 is a bit for frame synchronization,
04 is a bit for capability / command communication between terminals, and 105 is an order of data transmission to the communication line. The multiplexing condition of each data can be changed at any time between the terminal and the host using the capability / command communication bit 104.

FIG. 13 is a diagram showing a conventional packet format at the time of storage. In the figure, reference numeral 111 denotes information such as a transmission rate at the time of storage, a multiplexing rate of each data, and an encoding method of each data. The included header information, 112 is the number of sub-multiframes composed of packets, and 113 is multiplexed data multiplexed in the format shown in FIG.

At the time of storage, the line multiplexed data transmitted from the network is received by the stored data extracting unit 91, and the stored data extracting unit 91 extracts the multiplexed data to be stored.
Output to the packet generator 92. The packet generator 92
Then, a packet is generated in accordance with the format shown in FIG. 13 using the multiplexing rate and coding method of data at the time of communication as header information and output to the storage device as packet data.

At the time of reproduction, the packet data output from the storage device is received by the packet decomposing unit 93. The packet decomposing unit 93 notifies the header information of the packet to the system control unit. The system control unit instructs the line data generation unit 94 to match the operation mode of the communication terminal at the time of accumulation with the operation mode of the communication terminal at the time of reproduction using the BAS 104 shown in FIG. When the operation mode matching is completed by the line data generating unit 94, the packet decomposing unit 93 decomposes the packet and outputs the multiplexed data to be reproduced to the line data generating unit 94. In the line data generation unit 94, the FAS 103 and the BAS1 shown in FIG.
04 is rewritten to generate line multiplexed data and send it out to the communication network.

[0010]

In the conventional method, since data is stored in a multiplexed state of data adopted as an international standard, when the stored image is reproduced by a communication terminal, it is usually used. FEC (Forward Error Correctio)
(n: error correction) Since the image is displayed after the frame synchronization is established, the image cannot be displayed immediately. In addition, since the initial image is not always the one encoded in the frame, the initial image becomes dirty. Furthermore, since the buffer state of the terminal at the time of accumulation is different, an underflow or overflow of the buffer occurs, which causes various problems such as an inability to properly reproduce an image.

The amount of coding of the stored image is controlled by the terminal buffer state at the time of accumulation. However, in the conventional method, the buffer state of the terminal at the time of reproduction and that at the time of accumulation are not always the same. Therefore, problems such as buffer overflow and underflow occur. Further, in the conventional image reproducing apparatus, there is a problem that the stored image can be reproduced only when the compatible line rate of the terminal at the time of accumulation and the terminal at the time of reproduction is the same. For example, there is a problem in a case where an image stored in a terminal that supports only the line rate B using the ISDN basic interface is reproduced by a terminal that supports only the line rate 2B.

The present invention has been made in view of such circumstances, and separates respective data without performing accumulation in a multiplexed state of voices and images as in the conventional method.
In particular, it is necessary to perform data processing on images and store them in video frame units, and store them in a data format that enables image processing to solve various problems that occur during reproduction. Another object of the present invention is to solve a problem that an image cannot be displayed immediately when a stored image is reproduced. It is also necessary to control the insertion of fill bits by monitoring the amount of information to prevent the occurrence of buffer overflow or underflow in the reproduction terminal. It is still another object of the present invention to provide a stored image reproducing apparatus capable of performing reproduction even when a line rate that can be handled by a terminal at the time of accumulation and reproduction is different by performing transmission speed matching.

[0013] In order to achieve the above object, the present invention provides:
(1) multiplexed data receiving means for receiving multiplexed data of moving image data and audio data from a terminal connected via a communication network, and multiplexing data received by the receiving means as moving image data Data separating means for separating the data into audio data, video frame extracting means for extracting video frames as a unit from the moving image data separated by the data separating means, and video frames and separation extracted by the video frame extracting means Audio data
Packet video frame data and audio data
A packet generating unit for generating a packet, and a storage unit for storing the packet generated by the packet generating unit; and (2) the image storage device according to (1). definitive, from the read packets from the storage means, and packet disassembly means for separating the video frames and audio data, with respect to the separated video frame data by the packet decomposing means, for adjusting the amount of coded data A fill bit insertion unit for inserting a fill bit, and a data multiplexing unit for multiplexing the moving image data with the fill bit inserted by the fill bit insertion unit and the audio data separated by the packet disassembly unit. Multiplexed data transmission means; and (3) in the stored image reproducing apparatus according to (2), To over data transmission means, that monitors the amount of information of video frame data separated by the packet decomposing means, provided information amount monitoring means for controlling said fill bit inserting means, further, (4) the (3) In the stored image reproducing device described in (3), the information amount monitoring unit and the fill bit inserting unit are controlled to transmit the moving image data to the multiplexed data transmitting unit in accordance with the speed of the transmission path. (5) In the storage image reproducing apparatus according to any one of the above (2) to (4), the multiplexed data transmitting means is provided with the fill bit inserting means. An error correction frame generating means for generating an error correction frame by adding an error correction code to moving image data into which a fill bit has been inserted is provided. .

[0014]

According to the image storage apparatus of the present invention, a multiplexed input signal such as an image and a sound is separated into various data by a data separating means, and the FEC error correction is performed on the image by an error correcting means. A video frame is extracted by a video frame extracting means. Then, a packet is generated by adding information at the time of storage, such as a multiplexing rate at the time of storage and an encoding method, to data such as an image and a sound by a packet generating means,
The accumulation is performed by the accumulation means. Therefore, at the time of reproducing an image, it is possible to easily perform processing for solving various problems.

Further, the stored image reproducing apparatus of the present invention decomposes a packet based on the information added to the packet, and in the image, synchronizes the FEC of the partner terminal to be reproduced with a fill frame as necessary. Since transmission enables control, transmission of a stored image after FEC synchronization is established enables smooth and quick reproduction of the stored image. Also, when playing back stored images,
By controlling the amount of information in the same manner as in the image encoder, it is possible to prevent overflow or underflow of the buffer of the terminal that reproduces the stored image. Furthermore, even when the line rate that can be supported by the terminal at the time of storage and the terminal at the time of reproduction are different, the reproduction of the stored image can be performed by performing the transmission speed matching.

[0016]

Embodiments will be described below with reference to the drawings. FIG. 1 is a configuration diagram for explaining an embodiment of an image storage and stored image reproduction apparatus according to the present invention. In the figure, reference numeral 1 denotes a communication terminal, 2 denotes a communication host, 3 denotes a communication network such as ISDN,
4 is a camera for image input, 5 is a monitor for image output, 6
Is a handset for audio input / output, 7 is a system control unit of the terminal, 8 is an image encoding / decoding unit, 9 is an audio encoding / decoding unit, and 10 is encoded image data and encoded audio data. A multiplexed data transmission / reception unit for multiplexing control information and sending the multiplexed data to a line; 11 a system control unit of the host; 12 a multiplexed data transmission / reception unit of the host for separating and multiplexing control information from the multiplexed data; Recording device.

A moving image input from the camera 4 of the communication terminal 1 is subjected to inter-frame predictive encoding by an image encoding unit 8. The encoded image data is transmitted to the handset 6
Are multiplexed by the multiplexed data transmitting unit 10 together with the coded voice data coded by the voice coding unit 9 and the control information, and transmitted to the host 2 through the communication network 3.
On the communication host 2 side, the multiplexed data received from the communication terminal 1 is received by the multiplexed data receiving unit 12. The multiplexed data receiving unit 12 generates accumulated packet data from the multiplexed data of the received image and sound and transfers the data to the storage device 13. The storage device 13 accumulates a file in an appropriate form, that is, for image data in video frame units.

The stored data is read from the storage device 13 according to an instruction from the user or the host, and is sent to the multiplexed data transmission section 12 of the host. The transmission unit 12 of the host rewrites the control information stored as it is at the time of accumulation with new control information and transmits the new control information to the communication terminal 1 through the communication network 3 according to an instruction of the system control unit 11. In the communication terminal 1, the multiplexed data receiving unit 10 receives the multiplexed data in which the control information sent from the host is rewritten. The multiplexed data receiving unit 10 separates control information, image data, audio data, and the like, and the control information is sent to the system control unit 7.

The coded image data received by the multiplexed data receiving unit 10 is sent to the image decoding unit 8, and the moving image is decoded and reproduced according to the instruction from the system control unit 7, and the reproduced image is reproduced. Is displayed on the monitor 5. The separated audio data is decoded and reproduced by the audio decoding unit 9 and output from the handset 6. It should be noted that communication via the line is always performed bidirectionally even during the storage / reproduction operation, and control information can be communicated in the line connection state regardless of the presence or absence of image data or the like.

FIG. 2 is a block diagram of the receiving section of the multiplexed data transmitting / receiving section shown in FIG. 1. In FIG. 2, 14 is a receiving section, 21 is a line data separating section, 22 is an FEC error correcting section, and 23 is a video frame. The extraction unit 24 is a packet generation unit. The line data separator 21 separates multiplexed data received from the network. The FEC error correction unit 22 corrects the FEC error of the image data separated by the line data separation unit. The video frame extracting unit 23 extracts a video frame from the error-corrected image data. The packet generation unit 24 generates a packet from data such as images and sounds.

FIGS. 3A to 3C are diagrams showing image data between modules of the receiving unit in FIG. 2, and FIG.
It corresponds to the signal a in FIG. 2, and is composed of a synchronization signal for establishing FEC synchronization, a parity bit for performing FEC error correction, and a fill bit and information bit for adjusting the amount of encoded data. ing. FIG. 3B corresponds to the signal b in FIG. 2 and is obtained by performing FEC error correction and removing extra data such as fill bits. FIG. 3C corresponds to the signal c in FIG.
This is a video frame extracted for each (frame start code).

FIG. 4 is a diagram showing a packet configuration when storing is performed. Reference numeral 41 denotes header information in which information such as a multiplexing rate at the time of accumulation, an encoding method and an encoding capability is specified, 42 is the data length of an image, 43 is the data length of audio, 44 is the number of video frames of an image, and 45 is The data length of the video frame of the image and the video frame data, and 46 is the audio data.

Next, the operation of the image storage device according to the present invention will be described. At the time of accumulation, the line data separation unit 21
Then, the multiplexed data received from the communication network is separated into images, sounds, and the like, and the image data is output to the FEC error correction unit 22 and the audio data is output to the packet generation unit 24. The FEC error correction unit 22 receives the image data in the signal state shown in FIG. 3A and corrects the FEC error, etc.
Is output to the video frame extraction unit 23. The video frame extracting unit 23 searches for a PSC from the received data, and outputs data in a signal state shown in FIG. The packet generator 24 generates a packet of the received data such as image and audio data in accordance with the packet format shown in FIG. 4, and includes, as header information, information necessary for reproduction such as a multiplexing rate, an encoding method and an encoding capability. And outputs it to the storage device 13.

FIG. 5 is a block diagram of the transmitting section of the multiplexed data transmitting / receiving section in FIG. 1. In FIG. 5, reference numeral 15 denotes a transmitting section, 51 denotes a packet decomposing section, 52 denotes a fill bit inserting section, and 53 denotes an FE.
The C frame generator 54 is a line data multiplexer.
The packet decomposing unit 51 decomposes the received packet into data such as images and sounds. The fill bit insertion unit 52 inserts a fill bit into image data output from the packet decomposition unit. The FEC frame generation unit 53 generates an FEC frame from the image data output from the fill bit insertion unit. The line data multiplexing unit 54 generates line multiplexed data from image data output from the FEC frame generation unit, audio data output from the packet decomposition unit, and the like.

FIGS. 6A to 6C show the transmission unit 15 of FIG.
FIG. 6A is a diagram showing image data between modules of FIG.
Corresponds to the signal d in FIG. 5 and is video frame data. FIG. 6B corresponds to the signal e in FIG. 5, in which a fill bit is inserted. FIG. 6C corresponds to the signal f in FIG. 5 and is an FEC frame to which a FEC synchronization signal and a parity bit for correcting a transmission error are added.

Next, the operation of the transmitting section shown in FIG. 5 will be described. At the time of reproduction, the packet output from the storage device 13 is received by the packet decomposing unit 51. The packet decomposing unit 51 that has received the packet extracts the header information and notifies the system control unit 11 of the extracted header information. The system control unit 11
Corresponds to B shown in FIG.
Using the AS 104, an instruction is made to match the operation mode of the communication terminal during accumulation with the operation mode of the communication terminal during reproduction. When the operation mode matching is completed in the line data multiplexing unit 54, the packet decomposing unit 51 decomposes the packet, outputs the image data to the fill bit insertion unit 52, and outputs the audio data and the like to the line data multiplexing unit 54. Output.

The fill bit insertion unit 52 inserts a fill bit so that FEC synchronization is established in the communication terminal before reproducing the stored image, and the FEC frame generation unit 5
Output to 3. In the FEC frame generation unit 53, the FE
A C frame is generated and output to line data multiplexing section 54. The line data multiplexing unit 54 multiplexes data such as images and sounds according to the multiplexing format shown in FIG.
It generates line multiplexed data and sends it to the communication network.

As described above, according to the present invention, in a storage type image communication system, an effective data storage format for solving various problems at the time of reproduction is constructed, and the stored image is reproduced smoothly and quickly. That is, the line data separation unit 21 separates various data from an input signal in which images and sounds are multiplexed. Error correction unit 22
Performs error correction of the FEC of the image data output from the line data separation unit 21. Video frame extraction unit 2
3 extracts a video frame from the data output from the error correction unit 22. The packet generator 24 includes data output from the video frame extractor 23,
A packet is generated from the audio data output from the line data separation unit 21. The storage device 13 stores packets output from the packet generator 24. Thus, data is stored in video frame units.

The packet decomposing unit 51 decomposes packets output from the storage device 13 in which packets composed of images, sounds, and the like are stored by adding header information.
The fill bit insertion unit 52 inserts a fill bit into the image data output from the packet decomposition unit 51.
The FEC frame generation section 53 generates an FEC frame from the image data output from the fill bit insertion section 52. The line data multiplexing unit 54 generates line multiplexed data from the image data output from the FEC frame generating unit 53 and the data such as audio output from the packet decomposing unit 51. Thereby, the synchronization of the FEC of the communication terminal that reproduces the stored image is controlled.

FIG. 7 is another block diagram of the transmission unit of the multiplexed data transmission / reception unit in FIG. 1. In FIG.
, A packet disassembly unit, 72, a fill bit insertion unit, 73, an FEC frame generation unit, 74, a line data multiplexing unit, 7
Reference numeral 5 denotes an information amount monitoring unit. The packet decomposing unit 71 decomposes the received packet into data such as images and sounds. The fill bit insertion unit 72 inserts a fill bit into the received image data. The FEC frame generator 73 generates an FEC frame from the received image data. The line data multiplexing unit 74 generates line multiplexed data. The information amount monitoring unit 75 monitors the amount of information and controls insertion of fill bits as necessary.

FIGS. 8 (a) to 8 (c) are diagrams showing image data between modules of the receiving section in FIG. 7, and FIG. 8 (a) corresponds to the signal g in FIG. It is.
FIG. 8B corresponds to the signal h in FIG. 7, in which a fill bit is inserted. FIG. 8 (c) corresponds to the signal i in FIG. 7, a FEC frame <br/> parity bits, etc. is added for correcting the transmission error and FEC sync signal.

Next, the operation of the transmitting section shown in FIG. 7 will be described. During reproduction, the packet output from the storage device 13 is received by the packet decomposing unit 71. The packet decomposing unit 71 that has received the packet extracts the header information and notifies the system control unit 11 of the extracted header information. The system control unit 11
Corresponds to B shown in FIG.
Using the AS 104, an instruction is made to match the operation mode of the communication terminal during accumulation with the operation mode of the communication terminal during reproduction. When the operation mode matching is completed by the line data multiplexing unit 74, the packet decomposing unit 71 decomposes the packet, outputs the image data to the fill bit insertion unit 72 and the information amount monitoring unit 75, and outputs the audio data and the like to the line data. Output to multiplexing section 74.

The fill bit insertion section 72 inserts a fill bit under the control of the information amount monitoring section and outputs it to the FEC frame generation section 73. The FEC frame generation unit 73 generates an FEC frame and outputs it to the line data multiplexing unit 74. The line data multiplexing unit 74 multiplexes data such as images and sounds in accordance with the multiplexing format shown in FIG. 12 to generate line multiplexed data, and sends it out to the communication network.

As described above, the present invention prevents buffer overflow, buffer underflow, and the like from occurring in a reproduction terminal in a storage-type image communication system. That is, the buffer decomposing unit 71 decomposes the packet output from the storage unit that stores the packet composed of the image and the audio with the header information added. The fill bit insertion unit 72 inserts a fill bit into the image data output from the packet decomposing unit 71. The information amount monitoring unit 75 monitors the information amount of the image data output from the packet decomposing unit 71, and
2 is performed. The FEC frame generator 73 converts the image data output from the fill bit
Generate an EC frame. The line data multiplexing unit 74
Line multiplexed data is generated from image data output from the FEC frame generation unit 73 and data such as audio output from the packet decomposition unit 71. Thereby, the information amount of the stored image is controlled at the time of reproduction.

FIG. 9 is a block diagram showing still another configuration of the transmission section of the multiplexed data transmission / reception section shown in FIG. 1. In FIG. 9, reference numeral 76 denotes a transmission rate matching section. The code is attached. The transmission speed matching unit 76 controls the output of the received image data to match the transmission speed. For example, if the stored image is one in which 10 video frames are stored per second, 10 video frames per second may be used regardless of the transmission speed during reproduction.
Outputs one video frame.

FIGS. 10 (a) to 10 (d) are diagrams showing image data between the modules of the transmitting section in FIG. 9, and FIG.
Corresponds to the signal j in FIG. 9 and is video frame data. FIG. 10B shows video frame data corresponding to the signal k in FIG. 9 and whose output is controlled. FIG.
(C) corresponds to the signal m in FIG. 9 and has a fill bit inserted. FIG. 10D corresponds to the signal n in FIG. 9 and is an FEC frame to which a FEC synchronization signal and a parity bit for correcting a transmission error are added.

Next, the operation of the transmitting section shown in FIG. 9 will be described. During reproduction, the packet output from the storage device 13 is received by the packet decomposing unit 71. The packet decomposing unit 71 that has received the packet extracts the header information and notifies the system control unit 11 of the extracted header information. The system control unit 11
Corresponds to B shown in FIG.
Using the AS 104, an instruction is made to match the operation mode of the communication terminal during accumulation with the operation mode of the communication terminal during reproduction. If the operation mode matching by the line data multiplexing unit 74 cannot be performed due to the higher line rate of the terminal at the time of reproduction as compared with the terminal at the time of accumulation, the connection is performed in the closest operation mode. When the connection is completed, the packet disassembly unit 7
At 1, the packet is decomposed and the image data is output to the transmission speed matching unit 76. The transmission rate matching unit 76 controls the output of the received data and outputs it to the fill bit insertion unit 72 and the information amount monitoring unit 75.

The fill bit insertion unit 72 inserts a fill bit under the control of the information amount monitoring unit 75 and outputs it to the FEC frame generation unit 73. The FEC frame generation unit 73 generates an FEC frame and outputs it to the line data multiplexing unit 74. The line data multiplexing unit 74 multiplexes data such as images and sounds in accordance with the multiplexing format shown in FIG. 12 to generate line multiplexed data, and sends the data to the communication network.

As described above, according to the present invention, in the storage type image communication system, the stored image can be reproduced even when the transmission rate of the terminal at the time of storage is different from that at the time of reproduction. That is, the packet decomposing unit 71 decomposes a packet composed of an image, a sound, and the like by adding header information. The transmission speed matching unit 76 matches the transmission speed of the image data output from the packet decomposing unit 71. Fill bit insertion unit 72
Performs fill bit insertion. The information amount monitoring unit 75 monitors the information amount and controls the fill bit insertion unit 72. The FEC frame generation unit 73 generates an FEC frame from the image data output from the fill bit insertion unit 72. The line data multiplexing unit 74 generates line multiplexed data from the image data output from the FEC frame generating unit 73 and the data such as audio output from the packet decomposing unit 71. As a result, the stored image can be reproduced even when the transmission rate of the terminal at the time of storage is different from that at the time of reproduction.

[0040]

As is apparent from the above description, the present invention has the following effects. (1) Effects corresponding to the first, second, and third aspects: Since the image is stored in units of video frames, it is necessary to solve various problems that have occurred in the conventional apparatus when the stored image is reproduced. Processing can be easily performed. In addition, when playing back stored images, a fill frame composed of fill bits in advance is transmitted, and the F of the communication terminal is transmitted.
Since the stored image is transmitted after EC synchronization is established, the stored image can be reproduced smoothly and quickly. (2) Effect corresponding to claim 4: Since the amount of information is controlled when the stored image is reproduced, it is possible to prevent a buffer overflow or an underflow from occurring in the reproduction terminal. (3) Effect corresponding to claim 5: When reproducing the stored image, the output of the image data is controlled by adjusting the transmission speed, so that the terminal at the time of storage and the terminal at the time of reproduction can be handled. Reproduction can be performed even when the line rates are different.

[Brief description of the drawings]

FIG. 1 is a configuration diagram for explaining an embodiment of a stored image reproduction device according to the present invention.

FIG. 2 is a configuration diagram of a receiving unit of the multiplexed data transmitting / receiving unit in FIG.

FIG. 3 is a configuration diagram of image data between modules in the receiving unit of FIG. 2;

FIG. 4 is a diagram showing a packet format at the time of accumulation according to the present invention.

FIG. 5 is a configuration diagram of a transmission unit of the multiplexed data transmission / reception unit in FIG. 1;

FIG. 6 is a configuration diagram of image data between modules in the transmission unit of FIG. 5;

FIG. 7 is another configuration diagram of the transmission unit of the multiplexed data transmission / reception unit in FIG. 1;

8 is a configuration diagram of image data between modules in the transmission unit of FIG. 7;

FIG. 9 is a diagram showing still another configuration of the transmission unit of the multiplexed data transmission / reception unit in FIG.

FIG. 10 is a configuration diagram of image data between modules in the transmission unit of FIG. 9;

FIG. 11 is a configuration diagram of a conventional multiplexed data transmission / reception unit.

FIG. 12 is a diagram showing a conventional data multiplexing format.

FIG. 13 is a diagram showing a conventional packet format at the time of accumulation.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Communication terminal, 2 ... Communication host, 3 ... Communication network such as ISDN, 4 ... Camera for image input, 5 ... Monitor for image output, 6 ... Handset for voice input / output, 7 ... System control unit of terminal , 8: image encoding / decoding unit, 9: audio encoding / decoding unit, 10: multiplexed data transmission / reception unit of terminal, 11: host system control unit, 12: multiplexed data transmission / reception unit of host , 13 ... storage device, 14 ... receiving unit,
Reference numeral 15: transmission unit, 16: transmission unit, 21: line data separation unit, 22: FEC error correction unit, 23: video frame extraction unit, 24: packet generation unit, 51: packet decomposition unit, 52: fill bit insertion unit 53, an FEC frame generation unit, 54, a line data multiplexing unit, 71, a packet decomposing unit, 72, a fill bit insertion unit, 73, an FEC frame generation unit, 74, a line data multiplexing unit, 75, an information amount monitoring unit. , 76... Transmission speed matching unit.

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Keiichi Hibi, Inventor 22-22, Nagaikecho, Abeno-ku, Osaka-shi, Osaka Inside Sharp Corporation (72) Inventor Tsuneaki Iwano 22-22, Nagaikecho, Abeno-ku, Osaka-shi, Osaka Sharp shares In-company (72) Inventor Hirotaka Nakano 1-1-6 Uchisaiwaicho, Chiyoda-ku, Tokyo Nippon Telegraph and Telephone Corporation (72) Inventor Osamu Nakamura 1-1-6 Uchisaiwaicho, Chiyoda-ku, Tokyo Nippon Telegraph and Telephone Corporation (56) References JP-A-5-276194 (JP, A) JP-A-3-288268 (JP, A) JP-A 1-276853 (JP, A)

Claims (5)

(57) [Claims] 1. A multiplexed data receiving means for receiving multiplexed data of moving image data and audio data from a terminal connected via a communication network, and Data separating means for separating data and audio data, video frame extracting means for extracting video frames as a unit from moving image data separated by the data separating means, and video frames extracted by the video frame extracting means And separated audio data
Data, packet video frame data and audio data
An image storage device, comprising: a packet generation unit that generates a packet as a unit; and a storage unit that stores the packet generated by the packet generation unit. 2. A put in the image storage apparatus according to claim 1
That, from the packet read out from the memory means, the video
A packet decomposer for separating frame data and audio data, and a video file separated by the packet decomposer.
Fill bit insertion means for inserting fill bits for adjusting the amount of encoded data with respect to the frame data ,
Multiplexed data transmitting means having multiplexing means for multiplexing the moving image data into which the fill bit is inserted by the fill bit inserting means and the audio data separated by the packet decomposing means. Stored image reproducing apparatus. 3. The stored image reproducing apparatus according to claim 2, wherein the multiplexed data transmitting means monitors the information amount of the video frame data separated by the packet decomposing means, A stored image reproducing apparatus comprising an information amount monitoring means for performing control. 4. The stored image reproducing apparatus according to claim 3, wherein the information amount monitoring unit and the file are transmitted to the multiplexed data transmitting unit so as to match the moving image data with a transmission line speed. A stored image reproducing apparatus comprising a transmission speed matching means for controlling a bit insertion means. 5. The stored image reproducing apparatus according to claim 2, wherein said multiplexed data transmitting means transmits said multiplexed data to said moving image data in which said fill bit is inserted by said fill bit inserting means. And an error correction frame generating means for generating an error correction frame by adding an error correction code.