JPH05274807A - Multimedia recording method and device - Google Patents

Abstract

PURPOSE:To realize a multimedia recording method and device capable of performing recording and reproducing by synchronizing various kinds of communication media. CONSTITUTION:A data bit forming the location data according to a pointing operation at least and a data bit forming the audio data are continuously recorded in parallel, respectively. Thus since the location data and audio data is outputted as a syncrhonized form only by reproducing these continuous recordings, various kinds of communication media is recorded and reproduced by synchronizing them.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION The present invention relates to ISDN, for example.
The present invention relates to a multimedia recording method and device suitable for use in a terminal device compatible with (Integrated Services Digital Network).

[0002]

2. Description of the Related Art As is well known, in telephone communication, all information must be exchanged by voice, and even visual information must be expressed in words. Moreover, the images drawn by words vary from person to person, and in some cases it may not be possible to convey their will to the other person. In addition, with a normal telephone, communication cannot be taken unless the other party responds, and information cannot be sent unilaterally. Therefore, in order to eliminate such inconvenience, various devices such as a facsimile for transmitting image information and an answering machine for recording the other party's call are now in widespread use.

By the way, in recent years, smoother and more efficient communication has been demanded along with the sophistication of communication. Against this background, various communication media such as voice, image or data are integrated to provide various communication services. ISDN (Service Integrated Digital Network) to be provided is being constructed. In particular, with the spread of this ISDN, the practical application of telewriting is expected. This telewriting is a function called handwriting communication, and it transmits coordinate data corresponding to the trajectory of the pen and voice to the communication partner at the same time. As a result, the other party displays the locus of the pen as "handwritten information" along with the voice according to the coordinate data. That is, according to telewriting, a communication form that makes full use of both sight and hearing is realized.

[0004]

In the conventional facsimile and answering machine, the image information transmitted from the communication partner or the call can be individually recorded / recorded, but multimedia such as the above-mentioned telewriting is used. Unable to record communication. When recording this multimedia communication, for example, if the audio data and the coordinate data are individually recorded without being synchronized, the meaning of multimedia is lost during reproduction. Therefore, it is required to record each medium in a synchronized state and synchronously reproduce it.

The present invention has been made in view of the above circumstances, and an object thereof is to provide a multimedia recording method and apparatus capable of synchronously recording and reproducing various communication media.

[0006]

According to a first aspect of the present invention, in a multimedia recording method for recording at least audio data and position data in response to a pointing operation, physically serial data writing tracks. Of the data bit forming the position data and the data bit forming the audio data are independently and synchronized on different logical tracks. However, it is characterized by continuous recording.

Further, in the invention according to claim 2,
In a multimedia recording device for recording at least audio data and position data according to a pointing operation, a serial / parallel conversion means for changing a physically serial data writing track into a logically parallel track is provided, and the position data is stored. It is characterized by comprising recording means for continuously recording the data bits to be formed and the data bits forming the audio data independently and in synchronization on different logical tracks.

[0008]

According to the present invention, at least a data bit forming position data corresponding to a pointing operation,
Since the data bits forming the voice data are continuously recorded in parallel, the position data and the voice data are output in synchronization with each other simply by reproducing.

[0009]

Embodiments of the present invention will be described below with reference to the drawings.

A. First Embodiment FIG. 1 is a block diagram showing the configuration of a first embodiment according to the present invention. In this figure, 1 and 2 are FIFO
It is a buffer memory from which data is read in a format. The buffer memory 1 temporarily stores the audio data Da quantized to 8 bits, while the buffer memory 2 temporarily stores the pointing data Dp formed with a predetermined bit length. The pointing data Dp is, for example, data indicating a pen coordinate position placed on the tablet, or data output from a known pointing device such as a mouse or a digitizer. It should be noted that reading of these buffer memories 1 and 2 is performed by a CP (not shown).
Controlled by U.

Reference numeral 3 is an audio compression circuit for compressing the audio data Dp read from the buffer memory 1.
In the audio compression circuit 3, for example, 8-bit audio data Da is obtained by ADPCM (adaptive differential pulse code modulation).
Is compressed into 4-bit compressed audio data (D0 to D3) and output. Reference numeral 4 denotes a pointing data encode circuit (hereinafter, abbreviated as an encode circuit). The encoding circuit 4 separates the pointing data Dp into position data X and Y corresponding to x coordinates and y coordinates, and
A well-known error correction code such as CRC is added to each of the position data X and Y and output.

Reference numeral 5 denotes a port, which is audio compression data D0 to D3 supplied to input terminals T0 to T3 and input terminals T4 and T4.
The position data X and Y supplied to 5 are output to the parallel / serial interface 6. The parallel / serial interface 6 converts the audio compression data D0 to D3 and the position data X and Y supplied at 8 Kbps into 6-bit serial data and outputs it at a transmission rate of 48 Kbps. A recording / reproducing system 7 records the 6-bit serial data supplied from the interface 6 in the mode shown in FIG.

Next, the recording mode of the recording / reproducing system 7 will be described with reference to FIG. It should be noted that the recording mode shown in this figure represents a concept, and in order to simplify the description,
As an example, a case where a plurality of virtual tracks are provided on the magnetic recording tape is illustrated. Actually, data is written serially on the magnetic recording tape, but there are a plurality of logical tracks due to the parallel / serial interface 6 and the port 5. This logical track is the virtual track. As shown in this figure, for the 6-bit serial data, the above-described audio compressed data D0 to D3 are assigned to the virtual tracks 0 to 3, and the virtual tracks 4 and 4 are assigned.
The above-mentioned position data X and Y are assigned to 5.

As shown in this figure, at the beginning of recording,
Header information indicating the start of recording is written over all virtual tracks, and thereafter, each of the audio compressed data D0 to D3 is sequentially recorded in each virtual track 0 to 3 in synchronization with the sampling cycle of the position data X and Y. That is,
After the header information is written in all virtual tracks 0-6,
For the virtual tracks 4 and 5, one sampling period (T ₀ to
The position data X and Y in T ₁ ) are recorded. Here, as described above, the position data X and Y are provided with control data such as an error correction code in the encoding circuit 4. On the other hand, the audio compressed data D0 to D3 are sequentially and continuously recorded on the virtual tracks 0 to 3 in correspondence with the sequential recording of such position data.

According to such a recording mode, it becomes possible to output the position data X, Y and the audio compression data D0 to D3 in a synchronized form by simply reproducing. In addition, in the above-mentioned example, the mode of recording on the magnetic recording tape is shown, but the invention is not limited to this, and it is also applicable to the case of recording on a floppy disk, for example. Further, even when a semiconductor memory is used as a storage medium, the same recording form can be applied. In short, regardless of the type of recording medium, position data X, Y and audio compression data D0-
That is, it is sufficient to record them sequentially in a form corresponding to D3 in time series.

Next, the configuration of the first embodiment will be described with reference to FIG. 1 again. Reference numeral 8 denotes a serial / parallel interface, which converts the 6-bit serial data read from the recording / reproducing system 7 into parallel data composed of the audio compression data D0 to D3 and the position data X and Y, and outputs the parallel data. .. Reference numeral 9 is a port, and 10 is a decoding circuit for converting the position data X and Y supplied via the port 9 into coordinate values and outputting them. Reference numeral 11 is an audio expansion circuit for expanding the audio compression data D0 to D3 supplied via the port 9 and decoding the audio data Da. The audio decompression circuit 11 has a D / A converter, and the audio data D
A is D / A converted to generate an audio signal. An amplifier 12 amplifies and outputs the audio signal output from the audio expansion circuit 11. SP is a speaker that produces the audio signal output from the amplifier 12. A display 13 is composed of an LCD (liquid crystal display element) or the like, and displays a locus according to the coordinate values output from the decoding circuit 10 on the screen.

According to the above configuration, the audio data Da is subjected to the audio compression processing to become the audio compressed data D0 to D3,
On the other hand, the pointing data Dp is encoded into position data X and Y. Then, these data are converted into 6-bit serial data and supplied to the recording / reproducing system 7. In the recording / reproducing system 7, the recording mode shown in FIG. 2, that is, the header information indicating the start of recording has all virtual tracks 0-6.
The audio compressed data D0 is sequentially written in the form of synchronizing with the sampling cycle of the position data X and Y.
To D3 are recorded on the virtual tracks 0 to 3, respectively.

At the time of reproduction, the position data X and Y and the audio compression data D0 to D3 are output in synchronization by simply reading all virtual tracks continuously. As a result, it is possible to record and reproduce multimedia in synchronization. Next, the audio compressed data and the position data thus reproduced are subjected to audio decompression processing and decoding processing, respectively, and the trajectory synchronized with the audio is displayed on the display 1.
3 will be displayed.

B. Second Embodiment Next, FIG. 3 is a block diagram showing the configuration of the second embodiment according to the present invention. The second embodiment shown in this figure differs from the first embodiment described above in that the still image data is also recorded and reproduced. In addition, in FIG.
The same parts as those of the above are denoted by the same reference numerals, and the description thereof will be omitted. In FIG. 3, a voice processing circuit 20 quantizes a voice signal output from the microphone MIC to generate voice data Dp. Further, the audio processing circuit 20 D / A-converts the audio data Dp supplied from the outside and then amplifies the level so that the speaker SP produces a sound.

Reference numeral 21 is a tablet which generates a position signal corresponding to the position pointed by the pen 21a. A position detection circuit 22 detects a coordinate position from a position signal supplied from the tablet 21 and outputs pointing data Dp corresponding to the coordinate position. 24 is still image data D
It is a well-known scanner that produces s. A multiplexing circuit 25 multiplexes the audio data Da and the pointing data Dp based on the configuration of the first embodiment and outputs the multiplexed data as multiplexed data Dm. 26 is an AND circuit 26a, 2
6b and an OR circuit 26c.
A control unit 27 controls the synthesizer 26.

When supplying the multiplexed data Dm to the recording / reproducing system 7, the control section 27 generates signals of "1" from the control terminals T ₀ and " ₀ " from the control terminals T ₁ and T ₂ to generate a still image. When supplying the data Ds to the recording / reproducing system 7, signals of "1" from the control terminal T ₂ and "0" from the control terminals T ₀ and T ₁ are generated. Further, at the start / completion of recording in the recording / reproducing system 7, or from recording of the multiplexed data Dm to the still image data Ds.
When shifting to recording, a guard area signal Sg for forming a guard area, which will be described later, is generated from the control terminal T _1, and signals “0” are generated from the control terminals T ₀ and T ₂ . Reference numeral 28 denotes a separating device which separates the multiplexed data Dm and the still image data Ds supplied from the recording / reproducing system 7, and further separates the multiplexed data Dm into audio data Da and pointing data Dp and outputs them. ..

Next, the operation of the second embodiment having such a configuration will be described separately for the recording operation and the reproducing operation.

Recording Operation The recording / reproducing system 7 records the multiplexed data Dm and the still image data Ds in the manner shown in FIG. First, prior to the recording of both data Dm and Ds, the control unit 27 sends the guard area signal Sg to the control end T ₁
And a signal of "0" is generated from the control ends T ₀ and T ₂ . As a result, the synthesizer 26 supplies the guard area signal Sg to the recording / reproducing system 7. The guard area signal Sg is formed of a predetermined bit pattern. In the recording / reproducing system 7 to which the guard area signal Sg is supplied, the guard area G1 is recorded as shown in FIG.

Then, when the recording of the guard area signal Sg is completed, the control section 27 generates signals of "1" from the control terminals T ₂ and "0" from the control terminals T ₀ and T ₁ . As a result,
The synthesizer 26 supplies the still image data Ds to the recording / reproducing system 7. Then, the recording / reproducing system 7 sequentially records the still image data Ds with an N-bit width following the guard area G1. Then, when the recording of the data Ds is completed, the control unit 27 again generates the guard area signal Sg,
A guard area G2 (see FIG. 4) is formed. When this guard area G2 is recorded, the control unit 27 causes the control end T _0.
"1", it generates a signal of "0" from the control terminal T ₁ and T ₂ from. As a result, the synthesizer 26 supplies the multiplexed data Dm to the recording / reproducing system 7. In the recording / reproducing system 7, the multiplexed data Dm is sequentially recorded with a width of N bits following the guard area G2.

When the recording of the multiplexed data Dm is completed, the control section 27 synthesizes the guard area signal Sg with the synthesizer 26.
Is supplied to the recording / reproducing system 7 via the recording medium to form a guard area G3. Thus, in one recording operation, the guard areas G1 to G3 are formed, the still image data Ds is recorded between the areas G1 and G2, and the areas G2 and G3 are recorded.
The multiplexed data Dm is recorded between them. The area between the areas G1 and G2 is called page A data, and the area between the areas G2 and G3 is called page B data.

Reproduction Operation Page A data and page B recorded as described above
The data is reproduced as follows. First, when the reproduction data corresponding to the guard area G1 is output from the recording / reproduction system 7, the separation device 28 detects that the reproduction operation is being performed, and the page A data to be subsequently reproduced, that is, the still image data Ds is Display on the display 13. Next, when the reproduction data corresponding to the guard area G2 is output from the recording / reproduction system 7, the demultiplexing device 28 separates the multiplexed data Dm, which is the subsequently supplied page B data, into the audio data Da and the pointing data Dp. To do. Here, the separated audio data Da is supplied to the audio processing circuit 20, and after D / A conversion is performed in the circuit 20,
It is sounded as a voice from the speaker SP.

On the other hand, the pointing data Dp is supplied to the display 13 and displays an image showing the trajectory of the pen 21a. Here, as shown in FIG. 4, on the display 13, the still image of the first reproduced page A and the image of the pen trajectory of the subsequently reproduced page B are displayed in a superimposed state. .. Moreover, in this case, since the sound is produced in synchronization with the display of the pen track, the multimedia is reproduced in synchronization.

In the second embodiment described above, the multiplexed data Dm is recorded as the page B data, but instead of this, the same recording mode as that of the first embodiment described above on this page B is used. The audio data compressed in this manner may be continuously recorded together with the pointing data. By doing so, the reproduction frame synchronization function of the multiplexed data Dm in the demultiplexing device 28 can be eliminated, and the device 28 can also have a simple structure.

[0029]

As described above, according to the present invention, the data bit forming the position data according to the pointing operation and the data bit forming the voice data are continuously recorded in parallel. The position data and the audio data are output in synchronization with each other simply by reproducing. As a result, various communication media can be recorded and reproduced synchronously.

Further, in the configuration of the present invention, since a plurality of different data are independently recorded in a logical track called a virtual track and synchronized with each other without using a complicated multiplexing circuit, the multiple recording is performed. Realization of a media recording device is easy.

[Brief description of drawings]

FIG. 1 is a block diagram showing the configuration of a first embodiment according to the present invention.

FIG. 2 is a diagram showing a recording mode in the embodiment.

FIG. 3 is a block diagram showing the configuration of a second embodiment according to the present invention.

FIG. 4 is a diagram showing a recording mode in the embodiment.

[Explanation of symbols]

 3 ... Audio compression circuit, 4 ... Pointing data encoding circuit, 6 ... Parallel / serial interface, 7 ... Recording / reproducing system, Da ... Audio data, Dp ... Pointing data.

Claims (2)

[Claims] 1. A multimedia recording method for recording at least audio data and position data according to a pointing operation, comprising serial / parallel conversion means for changing physically serial data writing tracks to logically parallel tracks. A multimedia recording method, characterized in that the data bits forming the position data and the data bits forming the audio data are continuously recorded independently and in synchronization on different logical tracks. 2. A multimedia recording device for recording at least audio data and position data according to a pointing operation, comprising serial / parallel conversion means for changing physically serial data writing tracks into logically parallel tracks. A multimedia comprising a data bit forming the position data and a data bit forming the audio data, which are independently and synchronously recorded on different logical tracks. Recording device.