JPH04104677A - System and device for recording and reproducing information - Google Patents

Abstract

PURPOSE:To storage various information with flexibility and to improve efficiency for storage by forming the pair of information by time sequential information and data showing time to start reproducing the time sequential information, and storing this pair of information as one pair. CONSTITUTION:A CPU 1 inputs / outputs data and controls timing for the entire device. A media memory 2 stores digitized sounds, texts and graphic data or the like and according to the time sequential information and the data showing time to start reproducing the time sequential information is formed. Then, the plural pairs of information are stored in respect to the various kinds of time sequential information. Corresponding to the reproducing start time provided for each pair of information, the correspondent time sequential information is started being reproduced. Thus, various information can be reproduced at mutually flexibly synchronized timing and efficiency for utilizing the memory is improved.

Description

[Detailed description of the invention]

[Industrial Application Field] The present invention relates to a method for recording and reproducing audio, text, and images. [Prior Art] Conventionally, methods and devices for recording and reproducing audio, text, images, etc. are described in, for example, Japanese Patent Application Laid-Open No. 63-190470. A method is described herein in which digitized audio and video signals are stored in the same memory. The above-mentioned prior art is a device for recording and reproducing audio and image information, in which audio and image information are stored in the same memory. More specifically, for example, audio information is stored sequentially in the forward direction of the memory from the top address of the memory, and image information is stored sequentially in the reverse direction of the addresses from the end address of the memory.

[Problem to be solved by the invention]

In the above-mentioned conventional technology, since the time relationship during reproduction of audio and image information is not defined, there is no way to achieve synchronization other than to simultaneously start reproduction from the storage start position. Therefore, for example, in a state where the reproduction of an audio signal is temporarily stopped and the reproduction of an image is waited for, an audio signal representing "silence" must always be stored, which is not efficient. An object of the present invention is to store a plurality of time-series information such as audio and image information in an addressable storage medium. An object of the present invention is to provide a flexible storage method and device for various types of information in an information recording and reproducing device, and to improve storage efficiency.

[Means to solve the problem]

Means of the present invention for achieving the above object is such that a set of information is formed by time series information and data indicating the reproduction start time of the time series information, and the set of information for different types of the time series information is the same. A plurality of sets of information are stored in a storage medium, and the reproduction of the corresponding time-series information is started according to the reproduction start time of each set of information, or The purpose is to create a device using this.

[Effect]

A set of information is formed by time series information and data indicating the playback start time of the time series information, and this set is stored as one set, so even if multiple pieces of time series information of different types are accessed at the same time. , the order of their playback and their mutual timing are appropriately specified, which facilitates the playback procedure. Also, when one piece of information is being played back and the other piece of information is interrupted and placed on standby, the above data can include data on the timing of the interruption or standby, so silent data etc. can be recorded and played back during the standby period. There is no need. More specifically, each piece of time series information is stored at a predetermined location, and trigger pointers to each other's information can also be stored in the data. That is, when the processor reads previously reserved information, the following fixed length data is recognized as the reproduction start address of other information, and the other information is read. You can start playing. Furthermore, when other data reserved in advance is read, a certain length of information that follows is recognized as an interval length during which reproduction of the information is interrupted, and it is possible to suspend information reproduction during the period corresponding to this interval. In this way, each piece of information is flexibly linked and reproduced. It is also possible to start playing each piece of information from any position by storing the playback/stop status and playback address of each piece of information at a certain time in a table, and specifying an arbitrary index in this table. Become.

[Examples] Examples of the present invention will be described below with reference to the drawings. FIG. 1 shows the configuration of an information recording/reproducing apparatus according to an embodiment of the present invention. The CPUI inputs and outputs data and also controls the timing of the entire device. The media memory 2 stores digitized audio, text, graph ink data, and the like. On the other hand, general-purpose memory 3 has C
PU instructions and data supplied from the outside are temporarily stored. The interface controller 4 connects the device to an external information source such as a scanner or a video camera, and supports, for example, SC5I, GP-IB, and R5232-C. The audio C0DEC5 compresses/expands the audio signal. The display controller 6 develops the character string stored in the general-purpose memory 3 into a focused image,
Also, for example, a control word (primitive) describing the trajectory of a light pen is developed into a bit image and stored in the VRAM 7. Also, bit images that are expanded text stored in VRAM, bit image data supplied externally by scanners, cameras, computer graphics, etc., and bit image data that represent the trajectory of the light pen. The receiver also has the function of displaying, for example, the LCD screen 9 via the serial converter 8. At this time, the text, graphics, and pen trajectory are each expanded into separate VRAM areas, and the logical sum is calculated and displayed on the LCD screen 9 as shown in FIG. 1-1. The display controller 6 also determines whether the light pen 10 is active (writing) and reads the trajectory it draws. On the other hand, three types of interrupt signals are input to the CPUI. The first interrupt signal is a periodic signal of 1, for example, 8 kHz, which is the same as the sampling clock of the audio signal, and the second interrupt signal is the same as the sampling clock of the pen trajectory.
For example, it is a periodic signal of 10 Hz, and the third interrupt signal is configured to be generated by an oscillator 118 whose frequency can be changed, or a signal generated by the user pressing the switch 13 at an arbitrary timing. In addition, a keyboard 14 for instructing the functions of the apparatus from the outside is also connected. A method for storing various information in the above configuration will be described. Here, it is assumed that the necessary text and graphic data have been previously stored in the general-purpose memory 3 via the interface controller 4 or from the attached keyboard 14. As shown in FIG. 2, storage positions are determined at predetermined locations in the media memory 2 according to the media. It is assumed that all data is O in the initial state. The storage procedure will be explained below according to the flowchart shown in FIG. The general-purpose memory 3 is provided with a pointer that holds the next address for storing data for each medium. In the initial state, these pointers are set at the beginning of each storage area. Foreground processing then waits until text or graphics display is called up by keyboard input. On the other hand, the audio and light pen trajectory storage processing is waiting for a call in the interrupt processing. However, unless the timer switch 14-1 is turned on, interrupts are not permitted, so this information is not input and the timer is not updated. When text drawing is triggered while the switch 14-1 is on, it is first determined whether a pen trajectory is being recorded. If so, a text drawing trigger control, which will be described later, is stored in the pen trajectory storage area. If not, store the text drawing trigger control in the audio storage area. Next, the character string at a predetermined location in general-purpose memory is stored in the text storage area in media memory indicated by the text storage pointer, and is also stored in a text buffer in general-purpose memory for passing to the display controller. . The text storage pointer is incremented each time one word is transferred. After all character strings are transferred, a trigger wait controller, which will be described later, is stored at the end of the text storage area. On the other hand, when graphics drawing is triggered, the graphics drawing trigger control is stored in the pen or audio storage area in the same way as text, and from a predetermined location in general memory to the media memory graphics storage area and the bits. - Data is transferred to the map buffer. After the transfer is completed, the trigger wait controller is stored. Recording of the audio signal is started by pressing the record button on the keyboard 14. Actual recording is performed by a level 1 interrupt. Figure 4 shows this procedure. Interrupt level 1 is driven by a clock of, for example, 8 kHz, which is input to the audio C0DEC. When the record button is pressed, the audio C0DEC outputs a digitized audio signal at the same rate as the clock frequency. The CPU stores this in the audio storage area in the media memory and increments the pointer. Furthermore, P indicates whether or not it was in the recording state in the front side processing cycle.
Determination is made by checking STATES. If the current cycle is the first cycle after pressing the record button, the audio trigger control is stored in the storage area of another medium in the recording state. If there is no other medium in the recording state, it is determined that the audio recording is in a paused state, and the value of the pause counter □ is stored in the audio storage area together with the sleeve controller. On the other hand, when the recording button is not pressed, the pause counter is incremented. FIG. 5 is a diagram showing the contents of level 2 interrupt processing for recording the trajectory of the light pen. For example, a 10 Hz clock is input to the level 2 interrupt. The processing content is almost the same as the level 1 interrupt, so the details will be omitted. FIG. 6 shows the processing contents of level 3 interrupt. When the switch 12 is set to the auto side, the level 3 interrupt is driven by an oscillator whose frequency can be selected. The frequency is selected and set by the user from among frequencies such as 5.1.0.5 Hz. On the other hand, switch 12 is usrprg
In the case of the interrupt level 3 signal, the interrupt level 3 signal is connected to the switch 13. At this time, interrupt level 3 is activated by the user pressing switch 13. When interrupt level 3 is activated, the current media memory storage address for the information being recorded is stored in the position corresponding to the index value rc of the trigger address table. On the other hand, for information that is not recorded, '0
′ is stored. Finally, the trigger address table index value IC is incremented. In this way, when the switch 12 is set to auto, the storage address of each piece of information is stored at the selected frequency, while when the switch 12 is set to the usrprg side, the storage address when the user presses the switch 13 is stored. FIG. 7 shows how audio signals are stored. Here, an example is shown in which audio is stored as 8-bit PCM.
It is assumed that the audio signal is compressed, for example, with logarithmic characteristics shown in FIG. At this time, there is no audio code corresponding to the hexadecimal number 'FF'. Therefore, if this is defined as the start code of the controller (sequence start code 700), even if the controller is embedded in the voice code as in the example shown in FIG. 7, it can be distinguished from each other. In the example of FIG. 7, the sequence start code 700 is followed by the control mode number 702, and then the control code 703.
Finally, it is constituted by a control sequence end code 701. In this example, '0' is used as the control sequence end code 701.
0' is used. Table 1 also shows mode number 702. and an example of the control code 703. Modes O to 2 trigger other information, and a control code 703 indicates the memory storage address at which playback starts. Mode 3 instructs to interrupt the playback of the audio signal,
Control code 703 indicates the section length. Also,
Mode 4 instructs to suspend audio playback until triggered by other information. In this mode, the control code has no meaning, but dummy data is inserted. In this way, the controller has a fixed length regardless of the mode. Table 1 Figure 9 shows how text is stored in Table 2. For example, if the text is stored in JIS code, AO', which is an undefined code, can be used as the sequence start code 900. The rest is the same as in the case of audio, so the details will be omitted. Table 2 FIG. 10 and Table 3 show how graphic data is stored. Here, for example, it is assumed that a bit map is stored in 8-pit parallel format. 'AA' as sequence start code 1000
Suppose we use At this time, bit map data'
Although it cannot be distinguished from AA', specifying 4 as the mode number indicates that this 'AA' is not a sequence start code 100o but bit map data. Although this method increases the code length for the data 'AA', this is not a problem since it can be expected that the frequency of occurrence of this data is usually low. The rest is the same as in the case of audio, so the details will be omitted. The structure is shown in Table 3. Further, the first data after the trigger is expressed in absolute position. Sequence start code 1
Assume that +88' is used as 100. As a result, since the offset value at the lower left corner shown in FIG. 11(a) cannot be expressed as an offset, the offset value at the upper right corner is substituted for this. As a result, the followability in the lower left direction is slightly reduced, but this condition rarely occurs and has almost no effect. Table 4 Figure 11 and Table 4 show how the pen trajectory is stored. As shown in FIG. 11(a), the offset value of the pen tip from the locus in the front side insertion cycle is almost the same as the audio signal in the 8-pit control mode. However, if the control code is negative in mode 3, it indicates the life of the pen trajectory, and the pen trajectory after this period is erased. Furthermore, in mode 5, the line types and display colors to be used thereafter are defined. An example of this definition is shown in Table 5. Table 5 Using the method described above, each piece of information is stored in the media memory with a built-in time relationship. FIG. 12 illustrates an example of the operation of reproducing information stored as described above, according to an embodiment of the present invention. Further, FIG. 13 shows the state of the display at this time. This reproduction example will be explained step by step below. First, it is assumed that nothing is displayed in the initial state. Assume that the display is divided into a text display area 1300 summarizing the contents of the audio signal and the remaining graphics display area 1301 as shown in FIG. A summary sentence of the explanatory audio is displayed in the text area (■). When this is finished, audio playback is triggered, the explanatory audio code is read out, and the audio is decoded by the audio C0DEC. Start decoding the audio. Almost at the same time, a graphics drawing trigger is detected, and a drawing necessary for the explanation is drawn as shown in FIG. 13 (4). However, since it takes time to draw the graphics, audio playback is interrupted until the graphics are finished. At the end of drawing, the next explanatory summary display is triggered and the text area is rewritten (()). Next, audio decoding is triggered, and almost simultaneously, pen trajectory drawing is triggered (■). The reproduction method will be explained using FIG. 14. First, a playback operation is input from the keyboard 14 and an index at which playback is to be started is specified. If this specification is omitted, the index is set to 1, that is, playback starts from the beginning. Trigger table of each information corresponding to the specified index number
Read address (TAT (Thu, Ne)). If this value is O, it means that this information is not in the playback state, so the trigger flag (TRIGF(book)) is set to '
Set to 'Inactive'. On the other hand, if the valve zero value is stored, use that value as the trigger address and pointer T.
Store it in A (zero) and also write 'Act' in TRIGF (book).
Set ive'. FIG. 15 shows the foreground processing of playback. If text drawing is triggered, i.e. the text drawing trigger flag, TRIGF (CH) is 'Active
If it is e', character codes for one screen are read out in order from the trigger address. At this time, if a sequence start code 900 is detected midway, it is confirmed that a sequence end code 701 is located at a predetermined position. If it is normal, processing is performed according to the controller, but if it cannot be detected normally, this controller is ignored. Although a fixed value is used here as the sequence end code 701, if an error detection code such as a CRC code is used, it is possible to check whether there is an error in the entire controller. Furthermore, if graphics drawing has been triggered, bit image data for one screen is read out in the same manner as above. FIG. 16 shows the processing of controls in text drawing and graphics drawing. The triggered information flag is set to 'Active' and the pointer TA (book) is set to the trigger address included as a control code. Also, to enter the trigger wait state, set your own trigger flag to 'Ina
This is achieved by setting it to 'active'. FIG. 17 shows audio decoding and controller processing when drawing a pen trajectory, and the triggers for other media are the same as above. To transition to the sleeve state, set the self-trigger flag.
Inactive' and set the sleeve length included as the control code in the pause counter □. On the other hand, transition to the trigger wait state is achieved by setting its own trigger flag to Inactive' and setting the pause counter to O. Decoding of the audio signal is performed by interrupt level 1 processing. This is shown in FIG. 18. As mentioned above, this interrupt is activated only when the switch 14-1 is on.
It has a period of Hz. If audio decoding is triggered, it will read one code from the audio storage area, and all other than the control child will be audio C.
Output to 0DEC and decode. - Force controllers are handled as above. If audio decoding has not been triggered, the pause counter □ is verified, and if it is O, the process returns directly. If it is not O, the counter value is decremented, and if the result is 0, the self-trigger flag is set to 'Activ6'. FIG. 19 shows the contents of the interrupt level 2 process for drawing a pen trajectory, and the rough process contents are the same as the interrupt level 1 process. However, if the pose counter 2 is negative, it indicates the lifespan of the trajectory, and in this case, the counter value is incremented. If this result becomes 0, the pen trajectory buffer is cleared and the pen trajectory is erased. In the above embodiment, audio, text, graphics, and light pen trajectories are recorded together with their respective storage positions and playback timings, so that playback can be flexibly synchronized with each other. Furthermore, since there is no need to use dummy data for synchronization when the reproduction of information is paused, memory is used more efficiently. In the above embodiment, logarithmic companding was used to compress/expand the audio signal, but high-efficiency audio encoding methods such as ADPCM and CELP may also be used.Also, a light pen may be used as the pointing device. Although we have shown an example using a mouse, a mouse, tablet, touch panel, data glove, etc. may also be used. In addition, not only an LCD but also a CRT, a plasma display, etc. may be used as a display, and a display plate with two or more screens may be used as a display, and any of these may have both input and output functions. Good and
Alternatively, one may be used only for display purposes.Furthermore, the recorded data may be managed using multiple passwords.For example, the first password allows only reading, and the second
Writing may be permitted using a password. At this time, data for verifying the password may be simultaneously recorded in the recorded data. [Effects of the Invention] According to the present invention, various types of information can be played back at timings that are flexibly synchronized with each other. In particular, there is no need to insert dummy data to temporarily interrupt the playback of one piece of information, and memory usage can be improved. Increased efficiency.

[Brief explanation of drawings]

FIG. 1 is a block configuration diagram of an information recording and reproducing apparatus according to an embodiment of the present invention, FIG. 1-1 is a diagram explaining a graphics drawing method, FIG. 2 is an internal configuration diagram of a media memory, and FIG. A diagram showing the recording procedure, FIG. 4 is a diagram showing the recording procedure,
Figure 5 is a diagram showing the recording procedure of the pen trajectory, Figure 6 is a diagram showing the procedure for storing the recording position of each information, Figure 7 is a diagram showing how audio codes are stored, and Figure 8 is a diagram showing the audio code. Figure 9 is a diagram showing how character codes are stored, Figure 10 is a diagram showing how bit map data is stored, and Figure 11 is a diagram showing how character codes are stored. FIG. 12 is a diagram showing how trajectories are stored; FIG. 12 is a diagram showing an example of a playback operation of the device according to an embodiment of the present invention; FIG. 13 is a diagram showing an example of a display of a playback operation according to an embodiment of the present invention. 14 is a diagram showing a playback procedure, FIG. 15 is a diagram showing a text and graphics drawing procedure, and FIG. 16 is a diagram showing a control child processing procedure during text and graphics drawing,
FIG. 17 is a diagram showing the control child processing procedure during audio decoding and pen trajectory drawing, FIG. 18 is a diagram showing the audio decoding procedure, and FIG. 19 is a diagram explaining the pen trajectory drawing procedure. Description of symbols 1...CPU, 2...Media memory, 5...Audio C0DEC16...Display controller, 700,900.1000.1
100...--Sequence start code, 701
...Sequence end code, 1300...
-Text area, 1301...Graphics area.

Claims (1)

[Claims] 1. An information set is formed by time series information and data indicating the playback start time of the time series information, and the sets of information for different types of time series information are stored in the same storage medium. An information recording and reproducing method characterized in that a plurality of sets of information are stored, and reproduction of the corresponding time-series information is started in accordance with the reproduction start time of each set of information. 2. The information record according to claim 1, wherein the time series information includes at least one of an audio signal, a text string, graphics, a natural image, and a trajectory drawn by a pen. Playback method. 3. The information recording and reproducing method according to claim 1, wherein the storage positions of each set of information are simultaneously stored for each fixed period of time. 4. Claim 1, characterized in that the storage positions of each information set at a time determined by the user are simultaneously stored.
Information recording and reproducing method described in section. 5. The information recording and reproducing method according to claim 1, wherein the storage position of other information is stored mixedly at a certain position in the stored time-series information. 6. The information recording and reproducing method according to claim 1, wherein data on the length of a period during which reproduction of information is interrupted is stored in the stored time series information. 7. The information recording and reproducing method according to claim 1, wherein the time-series information includes the line type, thickness, color, and duration of display of the trajectory drawn by the pen. . 8. The information recording and reproducing method according to claim 5, wherein if it is determined that there is an error in the storage location of other stored information, this information is not used. 9. The information recording and reproducing method according to claim 6, wherein if it is determined that there is an error in the reproduction interruption time of the stored information, this information is not used. 10. Means for storing different time-series information at predetermined positions, means for externally inputting audio signals, text strings, graphic data, natural images, and pen positions, and reproducing the audio signals. means for displaying text strings, graphics, natural drawings, and trajectories drawn by a pen; information indicating playback timing at arbitrary positions in the stored information; and line type, thickness, and color to be displayed. 2. The information recording and reproducing method according to claim 1, further comprising means for storing a mixture of information indicating the information. 11. An information set is formed by time series information and data indicating a playback start time of the time series information, and a plurality of sets of the above information for different types of the time series information are stored in the same storage medium. , an information recording and reproducing apparatus characterized in that reproduction of the corresponding time-series information is started in accordance with the reproduction start time of each of the information sets. 12. The information record according to claim 11, wherein the time series information includes at least one of an audio signal, a text string, graphics, a natural image, and a trajectory drawn by a pen. playback device. 13. The information recording and reproducing apparatus according to claim 11, wherein the storage positions of each set of information are simultaneously stored for each fixed period. 14. The information recording and reproducing apparatus according to claim 11, wherein the storage position of each information set at a time determined by the user is simultaneously stored. 15. The information recording and reproducing apparatus according to claim 11, wherein the storage position of other information is stored mixedly at a certain position in the stored time series information. 16. The information recording and reproducing apparatus according to claim 11, wherein data on the length of a period during which reproduction of information is interrupted is stored in the stored time series information. 17. The information recording and reproducing device according to claim 11, wherein the data of the time-series information includes the line type, thickness, and color of the locus drawn by the pen, and the period during which the display is continued. . 18. The information recording and reproducing apparatus according to claim 15, wherein if it is determined that there is an error in the storage location of other stored information, this information is not used. 19. The information recording and reproducing apparatus according to claim 16, wherein if it is determined that there is an error in the reproduction interruption time of the stored information, this information is not used. 20. Means for storing different time-series information at predetermined positions, means for externally inputting audio signals, text strings, graphic data, natural images, and pen positions, and reproducing the audio signals. means for displaying text strings, graphics, natural drawings, and trajectories drawn by a pen; information indicating playback timing at arbitrary positions in the stored information; and line type, thickness, and color to be displayed. 12. The information recording and reproducing apparatus according to claim 11, further comprising means for storing a mixture of information indicating the information.