JPH1051747A - Image/voice data transmission method, equipment and system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reproduce voice data without intermission even when a through put of a data receiver side is lower than that at a data transmitter side. SOLUTION: For example, image data by one frame in (1) and voice data a-d for four frame periods (1)-(4) are sent for one frame period. Thus, even in the case of the frame periods (2), (3) for which the data receiver side cannot receive data through the internal processing, voice data (1)-b, (1)-c corresponding to the frames are stored in advance and then reproduced.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image / audio data transmission method, apparatus and system, and more particularly to a system for transmitting digital image data and audio data read from a moving image file via a transmission medium. It is.

[0002]

2. Description of the Related Art At present, techniques for reproducing digital moving image data with sound using a personal computer or the like have been developed. In the current technology, data is read from a digital moving image file with sound, and predetermined processing is performed to display image data and reproduce sound data. Generally, the format of this moving image file is 1 as shown in FIG.
The image data for one frame and the audio data for one frame period are interleaved.

[0003] Also, as a standard for digital data transmission, I
There are synchronous transmission methods such as EEE1394. When moving image transmission is performed using this synchronous transmission method, moving image transmission can be performed at timing synchronized with the frame period.
In this case, generally, as shown in FIG. 4, data for one frame is divided into a plurality of packets (consisting of a plurality of image packets and one audio packet), and data transmission is performed within one frame period. For example, if the data sending side has a capability of processing data of 30 frames per second, the one frame period is 1/30 second.

[0004]

However, in the case where the capability of the data receiving side is low and only data of, for example, 10 frames per second can be processed, as shown in FIG.
After receiving the frame data of (1), the frame data of (1) must be processed while the frame data of (2) and (3) are being transmitted. The frame data cannot be received. For this reason, there has been a problem that audio data is lost during a period during which reception is not possible, and audio reproduction is interrupted on the receiving side.

The present invention has been made to solve such a problem, and can reproduce sound without interruption even when the processing capability of the data receiving side is lower than that of the data transmitting side. The purpose is to be.

[0006]

An image / audio data transmission method according to the present invention is a method for transmitting image data and audio data via a transmission medium, wherein one frame of image data and a plurality of frames of image data are transmitted. The audio data is transmitted during one frame period.

[0007] An image / sound data transmission apparatus according to the present invention comprises: an image reading means for sequentially reading one frame of image data from a moving image file composed of image data and sound data; Audio reading means for sequentially reading audio data for a plurality of frames including frames of image data obtained from the moving image file;
A synchronous transmission unit for sequentially transmitting the image data for a frame and the audio data for a plurality of frames read by the audio reading unit for each one frame period.

An image / audio data transmission system according to the present invention comprises: an image reading means for sequentially reading one frame of image data from a moving image file composed of image data and audio data; Audio reading means for sequentially reading a plurality of frames of audio data including the frame of the read image data from the moving image file; and image data for one frame read by the image reading means and read by the audio reading means. Audio data for multiple frames
Synchronous transmission means for sequentially transmitting data every frame period, data reception means for receiving data transmitted by the synchronous transmission means in a receivable state, and image data for one frame received by the data reception means And an audio reproducing means for sequentially reproducing the audio data for a plurality of frames received by the data receiving means while the image data for one frame is displayed. Features.

According to another feature of the present invention, the audio data for a plurality of frames read by the audio reading means includes audio data corresponding to a frame of the image data read by the image reading means, And at least audio data corresponding to a frame in a period during which data cannot be received by the receiving means.

Since the present invention comprises the above technical means, when transmitting image data and audio data, one frame of image data and a plurality of frames of audio data are transmitted every one frame period, and are processed on the receiving side. Is done. As a result, even during a frame period during which data cannot be received due to internal processing (a period until the data can be received next time), the reception side previously holds audio data corresponding to the unreceivable frame. You will be able to play it.

[0011]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram of a video / audio data transmission method according to the present invention; FIG. 1 is a diagram for explaining an embodiment of an image / audio data transmission method according to the present invention, and FIG. 2 is a block diagram of an apparatus and a system for realizing such an image / audio data transmission method. FIG. For the sake of explanation, the processing capacity of the transmission side is 30 per second.
And the processing capacity of the receiving side is 10 frames per second.

As shown in FIG. 2A, the image / audio data transmission apparatus (transmitting side) of the present embodiment includes a moving image file 1, an image reading unit 2, an audio reading unit 3, and a synchronous transmission unit 4. And the transmission medium 5
Transmit audio data. As shown in FIG. 2B, the receiving side device includes a data receiving unit 6, an image displaying unit 7, and an audio reproducing unit 8, and displays and reproduces digital image and audio data received from the transmission medium 5. I do.

On the data transmitting side, as shown in FIG.
From a moving image file 1 in which image data for one frame and audio data for one frame period are interleaved, one frame of image data and four
The audio data for the frame period is read, and transmission is performed using synchronous transmission. In this case, data reading and data transmission are performed every 1/30 second.

For example, the image reading means 2 of FIG.
In the frame period for reading the frame image of (1) shown in (1), the audio reading means 3 outputs the frame audio a of (1) to (4).
.. D are read out, and the synchronous transmission means 4 sends out the read image data for one frame and audio data for four frames to the transmission medium 5 within one frame period. (2),
Similarly, in the frame period for reading the frame image of (3), for example, the frame sound of (1) to (4) is read, and the read image data of one frame and the sound data of four frames are converted into one frame. It is transmitted to the transmission medium 5 within the period.

Next, in each frame period in which the image reading means 2 reads the frame images of (4) to (6), the audio reading means 3 converts the frame sounds a to d of (4) to (7) into each frame cycle. The synchronous transmission means 4 reads the image data for one frame and the audio data for four frames to the transmission medium 5 within each frame period. The above processing is repeated in the same manner, and data transmission is performed.

On the other hand, on the data receiving side, A shown in FIG.
The data receiving means 6 starts the reception of the frame data (1) at the time B, and ends the reception at the time B. When the reception is completed, the processing of the received data is started.
The display of the image by the frame data of (1) is started from the time of (1), and the data processing is ended at the time of E. During this data processing, data cannot be received by the data receiving means 6, or even if the data can be received, the data cannot be processed. Therefore, the frame data of (2) and (3) cannot be received.

As described above, since the processing of the frame data of (1) ends at the time of E, the data can be received during the period from E to F in FIG. However, since no packet has been transmitted at this point, the data receiving side enters a standby state. Then, data reception is started again by the data receiving means 6 from the time F at which the frame data arrives at (4), the reception is ended at the time G, and processing of the received data is started. During the period from F to G receiving the frame data of (4), the frame image of (1) is continuously displayed,
The display of the frame image of (4) starts from the time G at which the reception is completed.

As for the audio data, the audio reproduction means 8 shown in FIG.
At time (1), reproduction of the audio data of (1) -a is started. this
The audio data (1) -a is audio data for one frame period on the data transmission side, and is synchronized with the frame of the image data (1). The reproduction of the audio data (1) -a whose reproduction has been started at the time B ends at the time C at which one frame period has elapsed.

At this point, the frame image data of (1) is being processed, and the frame data of (2) has not been received, but the audio data of (1) -b has already been received during the period AB. Therefore, the reproduction of the audio data (1) -b is started from the time C. The audio data of (1) -b is transmitted to (2)
The audio data is synchronized with the frame of the image data, and the reproduction is ended at the time D at which one frame period has elapsed from the time C.

At the time when the reproduction of the audio data of (1) -b is completed, the frame image data of (1) is being processed.
Although the frame data of (3) has not been received, since the audio data of (1) -c has already been received during the period A to B,
At time D, the reproduction of the audio data (1) -c is started. The audio data of (1) -c is audio data synchronized with the frame of the image data of (3) on the reproduction side, and the reproduction ends at the time of G just after one frame period has elapsed from D.

At the time G, since the frame data of (4) has been received, the reproduction of the audio data of (4) -a is started here. The audio data of (4) -a is audio data synchronized with the frame of the image data of (4) on the reproduction side, and the reproduction ends at the time of H, which is exactly one frame period from G. Hereinafter, similarly, (4) -b, (4)-
The audio data of c is reproduced.

As described above in detail, according to the digital image / audio data transmission method of the present embodiment, even when the frame data of (2) and (3) cannot be received due to internal processing on the data receiving side, The audio data corresponding to the frame can be reproduced continuously. (5), (6),
Similarly, audio data corresponding to the frames (8), (9),... Can be continuously reproduced even if the frame data cannot be received.

[0023]

As described above, according to the present invention, one frame of image data and a plurality of frames of audio data are transmitted in one frame period. Even during a frame period during which reception cannot be performed, audio data corresponding to those frames can be held and reproduced in advance. Therefore, even if the receiving side has a lower processing capacity than the data transmitting side and can only partially receive the transmitted moving image data with sound, continuous sound can be reproduced.

[Brief description of the drawings]

FIG. 1 is a diagram for explaining a digital image / audio data transmission method according to an embodiment of the present invention.

FIG. 2 is a diagram showing a configuration of an apparatus and a system for realizing the digital image / audio data transmission method shown in FIG.

FIG. 3 is a diagram showing a structure of a general moving image file with sound.

FIG. 4 is a diagram for explaining a state of conventional moving image data with sound transmission using a synchronous transmission method.

FIG. 5 is a diagram for explaining a state of reception of moving image data with sound in the related art using a synchronous transmission method.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 moving image file 2 image reading means 3 sound reading means 4 synchronous transmission means 5 transmission medium 6 data receiving means 7 image display means 8 sound reproducing means

Claims (4)

[Claims] 1. A method of transmitting image data and audio data via a transmission medium, wherein one frame of image data and a plurality of frames of audio data are transmitted in one frame period. Characteristic image / audio data transmission method. 2. An image reading unit for sequentially reading one frame of image data from a moving image file composed of image data and audio data, and a plurality of frames including a frame of the image data read by the image reading unit. Voice reading means for sequentially reading voice data of one frame from the moving image file, and one frame of image data read by the image reading means and voice data of a plurality of frames read by the voice reading means. An image / sound data transmission device, comprising: a synchronous transmission unit for sequentially transmitting data every frame period. 3. An image reading means for sequentially reading one frame of image data from a moving image file composed of image data and audio data, and a plurality of frames including a frame of the image data read by the image reading means. Voice reading means for sequentially reading voice data of one frame from the moving image file, and one frame of image data read by the image reading means and voice data of a plurality of frames read by the voice reading means. Synchronous transmission means for sequentially transmitting data every one frame period; data reception means for receiving data transmitted by the synchronous transmission means in a receivable state; and an image for one frame received by the data reception means. Image display means for displaying data, and a plurality of data received by the data receiving means. Video and audio data transmission system comprising the audio data of the frame component, and a sound reproducing means for sequentially reproducing while displaying the image data of the one frame. 4. The sound data for a plurality of frames read by the sound reading means includes sound data corresponding to a frame of the image data read by the image reading means and sound data corresponding to a period during which data cannot be received by the data receiving means. The video / audio data transmission system according to claim 3, wherein the video / audio data transmission system includes at least audio data corresponding to a frame.