JPH07319751A - Integrated management method for data files related to video, voice and text - Google Patents

Abstract

PURPOSE:To facilitate alterations of the contents of data and a recording/ reproducing system by changing the independent data files of video, voices and texts into an integrated file after adding the dividing positions and the control data to those data files. CONSTITUTION:A video file V1, an audio file A2 and a text file T3 are produced by their inputs respectively. When these files are recorded on a recording medium, the data on the files are connected together with their file blocks maintained as they are. Then the segmenting positions of the files and the control data which prescribe the reproduction timing of each file are added to these files so that an integrated file TO1 is obtained. When the recorded files are reproduced, the file TO1 is divided into three parts in a memory based on the file segmenting position information recorded in the control data, and the video information, the audio information and the text information are reproduced with synchronization secured among those files V1, A2 and T3 respectively based on the reproduction timing information.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention is an apparatus capable of recording and reproducing information by organically combining video information, audio information and text-related information (hereinafter referred to as multimedia equipment).
Relates to an integrated management method for video, audio, and text-related data files.

[0002]

2. Description of the Related Art The development of electronic technology has been remarkable, and it has made possible the advent of a computer capable of recording and reproducing image information, audio information and text-related information by organically combining them. This kind of computer is called a multimedia device, which breaks the conventional concept of a computer and is expected to be applied to various fields. The video information referred to here includes still images and moving images, and the audio information is a concept including music and voice, squeal of animals, and other sounds represented by sound effects, and text related information. Includes not only sentences and programming data represented by character data such as characters and symbols, but also external characters and enlarged characters displayed in the graphic mode, enlarged symbols, and titles that can be superimposed on the video information. It also includes simple graphic data such as characters.

A multimedia device is generally a display device for displaying video information and text-related information, an audio reproducing device for reproducing audio information, and an input for inputting each data of the video information, audio information and text-related information. Device,
It refers to one provided with a recording device for recording video data, audio data, and text-related data input through the input device, and a computer main body for controlling these devices and processing the data. Recently, audiovisual equipment such as video cameras, videotape recorders, TV receivers, laser discs, audio sets, etc., or communication means such as facsimiles, telephones, etc. have been connected to such multimedia equipment. Then, it is also proposed to control these external devices. A "target job" processed through such a multimedia device is generally called a job.

Multimedia devices handle video data, audio data, and text-related data, and there are various methods for recording and reproducing these data. For example, moving image compression methods such as MPEG and still image compression methods such as BMP and GIF are well known as recording and reproducing methods for video data, and MIDI, as recording and reproducing methods for audio data.
WAV and various PCMs, and text-related data include EBCDIC code and ASCII code. In addition to these, many recording / reproducing methods coexist, and each application operating on a multimedia device selects one of these recording / reproducing methods for each of video data, audio data, and text-related data. Select and combine each one. Here, the application refers to what is called moving image reproduction software or still image reproduction software, which displays digital data recorded in a recording medium on a computer display along with audio information and text-related information. And many things are in circulation.

For example, as shown in FIG. 9, there are V1 system, V2 system, V3 system ... as the video recording / reproducing system, and A1 system, A2 system, A3 system ... as the audio recording / reproducing system, and the text related recording. T1 system, T2 system,
Assuming that there is a T3 method ..., as shown in FIG. 10, in the application A, V1 method-A2 method-T3
A combination of methods is adopted, a combination of V2 method-A1 method-T2 method is adopted in the application B, while a combination of V3 method-A1 method-T1 method is adopted in the application C. To be Which combination to select depends on the development concept of the person in charge of software development.

As shown in FIG. 11, each system corresponds to video data, audio data and text-related data recorded in a unique data format. For example, even if the video finally expressed is the same, if the recording / playback method is different, the codes that make up the video data are completely different. File control data to control is required separately. When an application performs recording / playback operations on these various data, it is necessary to integrally manage the video data, audio data, and text-related data in consideration of the difference in the data formats.

Conventionally known integrated management methods for video data, audio data and text-related data are roughly classified into the following two. As shown in FIG. 12, the visual data, the audio data, and the text-related data are converted into VISUAL. V1, TE
XT. T3, AUDIO. In addition to recording in an independent file format such as A2, file control data for controlling playback timing of each file is provided independently of the application, and recording / playback of each file is managed with reference to this file control data. how to.

As shown in FIG. 13, video data, audio data, and text-related data are integrated while taking in the file control data in a format most suitable for the expression format that the application intends to realize, and recorded and reproduced as one file. how to. With this method, video data, audio data, and text-related data are recorded in a completely integrated state without being divided, and each video, audio, and text-related data is most suitable for the expression format that the application intends to realize. Since the data is stored in the format, the storage area for each data is not neatly divided. For example, as one specific example of this method, there is a method of time-series management of each data related to video, audio, and text. For example, in the case of adopting a format in which 1 second is time-divided into 30 frames to express a moving image, as shown in FIG. 14, 1/30 seconds worth of video data, audio data, and text-related data are treated as one block A storage form in which 30 units are combined will be adopted, and the division between data will not be clear. Further, even when such a time division method is not adopted, the arrangement of the video data, the audio data and the text related data is arranged in an optimum state for the application side so that they are inseparably integrated.

[0009]

Although the above file management methods have their respective advantages, they also have drawbacks. In this method, since video data, audio data, and text-related data are recorded in independent file formats, for example, replacement of video data or change of recording / playback method can affect audio data or text-related data. The same applies to replacement of voice data and text-related data, change of recording / playback method of voice data and text-related data, and the like. From an application developer's point of view, this means that the content and recording / playback method of each data related to video, audio, and text can be freely set and constructed without considering the relationship with other data. This means that even if the recording / playback method of a file is changed for the purpose of enhancing the functionality of the application, only the relevant file (for example, only the video data file) is controlled for each file. There is an advantage that the application can be recreated without changing the basic skeleton of the program just by replacing it with.

On the other hand, since the video data, the audio data and the text related data are recorded in the independent file format in the other method, the correspondence relationship between the video, audio and text related files is recorded when the file is copied, moved or deleted. It is necessary to manage, and it is necessary to incorporate into the application a file management function that "handles all corresponding video, audio, and text-related files as a unit". It is also necessary for the application to be provided with a file management function related to "action when the consistency between files cannot be achieved" in case one of the corresponding files is lost or missing for some reason. Yes, the functions of the application side will be complicated and the load will be heavy. Loss or loss of files is relatively unlikely to occur when operating files through a dedicated application, but is likely to occur when users directly operate files using other file management utility software. File management functions become even more important.

In the method of (1), since all the video data, audio data and text-related data are stored in one file, there is no possibility that any one of the video data, audio data and text-related data will be lost or lost. . In this method, the corresponding files of video data, audio data, and text-related data are handled as one file completely, so even if loss or loss occurs, all of the video data, audio data, and text-related data are Will not be read at once, and no inconsistency between files will occur. Therefore, there is an advantage that the file management can be simplified and the load on the file management function applied to the application can be reduced. On the other hand, in this method, since each of the video, audio, and text-related data is inseparably integrated into one file in a form most suitable for the expression form that the application intends to realize, the video, audio, and text-related data are integrated. Each data has the drawback that its function is limited by the structure of the application, and since each data related to video, audio and text cannot be separated from one file and handled as an independent file, the application's function enhancement etc. For the purpose, there is a drawback that the content of each data related to video, audio and text and the recording / reproducing system cannot be freely changed, and there is a drawback that the degree of freedom in application development is significantly limited.

As described above, the conventional file management method has advantages and disadvantages. The present invention has been made in view of the above situation, and before recording on a recording medium or in a state of being read from the recording medium, each data related to video, audio, and text can be handled as an independent file, and the recording medium By making it possible to handle the video, audio, and text-related data as an integrated file that is completely integrated in the state of being recorded, the contents of the video, audio, and text-related data and the recording / playback method can be changed. It is easy to do, and there is no loss of some of the data related to video, audio, and text for file operations such as copying, moving, and deleting of each data, and the application side to prepare for data loss, etc. Video, audio, and text-related data that can reduce the burden of file management functions required for Integrated management method for datafile is to provide cents.

[0013]

The present invention, which has solved the above problems, has the following configuration. That is, a display device that displays video information represented by still images and moving images, text related information represented by characters and symbols, an audio reproduction device that reproduces audio information represented by music and voice, and the image. An input device for inputting each data of information, text-related information and audio information, a recording device for recording video data, audio data and text-related data input through the input device, the display device, a music reproducing device, an input In a multimedia system including a computer main body for controlling the device and the recording device and performing data processing, a video data file, an audio data file, and a text-related data file that exist independently are separated from each other by dividing positions and Add control data that specifies the playback timing of each file, and When these file blocks are maintained, the data are combined to form an integrated file, which is recorded on the recording medium, and at the time of reproduction, the integrated file is recorded based on the division position information of the file recorded in the control data. The video data file part, the audio data file part and the text related data file part are divided and taken out to restore the video data file, the audio data file and the text related data file, and the playback timing information included in the control data is referred to. It is characterized by reproducing video information, text related information and audio information.

Further, when reading each file part from the integrated file, control is performed while maintaining the form of the integrated file as described in claim 2 without dividing each file part from the integrated file and restoring the original file. Directly access the video, audio, and text related file parts in the integrated file while recognizing the boundaries between the video, audio, and text related file parts in the integrated file based on the file division position information recorded in the data. However, the video information, the text related information, and the audio information may be reproduced by referring to the reproduction timing information included in the control data.

The data groups related to video, audio and text stored in the integrated file are expressed as "file parts". However, in the state of being stored in the integrated file, these are video, audio and text. Since each text-related data group has already been solved for the format of the file, it is not appropriate to express it as "file" in the strict sense. On the other hand, in the sense that the file block is maintained, each file before integration is It corresponds to and is expressed as a "file part" by including these meanings.

[0016]

The outline of the file operation according to the method of the present invention is as follows. First, in the case of creating an integrated file, video information, audio information, and text-related information are input to a multimedia device by using respective input devices, so that three independent video data files, audio data files, and text-related data files can be created. Create two files. Next, each of these files is data-combined while maintaining the form of the file block, and further to this combined file,
By adding control data that defines the dividing positions of video data, audio data, and text-related data and the reproduction timing of each file, the whole is made into one integrated file and recorded on the recording medium. Next, when reproducing the recorded integrated file, first, the integrated file is read from the recording medium. Next, the integrated file is divided based on the file division position information recorded in the control data stored in the integrated file, and the integrated file is divided into three independent data files: a video data file, an audio data file, and a text-related data file. Get the original file. In some cases, the video data, the audio data, and the text-related data in the integrated file may be directly accessed while recognizing the boundaries between the files while maintaining the integrated state without obtaining the three independent original files from the integrated file. When extracted as three independent files, the reproduction timing information included in the control data is referenced to operate each of the video, audio and text related files to reproduce the video information, text related information and audio information. When directly accessing the video, audio, and text-related file parts in the integrated file while recognizing the boundaries between the files while maintaining the integrated state, refer to the playback timing information included in the control data and refer to the video and audio. And video information by operating each file part related to text,
Plays text related information and voice information.

[0017]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The details of the present invention will be described below with reference to illustrated embodiments. FIG. 1 shows an outline of a multimedia device to which the present invention is applied. The multimedia device shown in the figure is an integrated personal computer (hereinafter,
Although referred to as a personal computer), the personal computer may be a tower type, a desktop type, or a notebook type. Furthermore, as multimedia equipment, complex equipment capable of simple operations that does not fall into the category of conventional personal computers, home game equipment that is expected to appear in the future, or other equipment that is integrated with televisions, video tape recorders, etc. May be

The multimedia device comprises a display device 1, an audio reproducing device 2, a video information input device 3, an audio information input device 4, a text-related information input device 5, a recording device 6, and a computer main body 7. .

The display device 1 displays video information represented by still images and moving images and text related information represented by characters and symbols. Although a CRT display is adopted in the illustrated example, a liquid crystal display panel or a television receiver may be used. The audio reproducing device 2 is configured to
It is used to reproduce the sound of animals and voice information such as sound effects, and is composed of a sound board, an amplifier, a speaker and the like. As the video information input device 3, a video camera, a video tape recorder, a moving image capturing device such as a laser disk or a moving image reproducing device, or a still image capturing device such as a digital camera or an image scanner is used as an interface board corresponding to each device. Besides being adopted in combination, it also applies to keyboards, mice, touch panels, etc. that can draw graphic images on the display screen by manual operation. A microphone, an analog record, a CD is used as the voice information input device 4.
In addition to adopting a record, tape recorder, electronic musical instrument, audio input from a video camera, etc., a keyboard etc. which can directly input musical score data that can be converted into electronic sound inside the computer are also targeted. The text-related information input device 5 is intended for a keyboard capable of directly inputting characters, symbols and programming data, and for converting input characters into kana-kanji characters, and a device capable of extracting and inputting from data recorded in various recording media. Further, the input device capable of inputting graphic data represented by decorative characters such as title characters is also targeted. The recording device 6 is for recording each text-related data including video, audio, and programming data input through the input device, and is MO (magneto-optical disk), MD (mini disk), hard disk (HDD). In addition to rewritable ones such as a floppy disk (FDD), a cassette streamer, and a large capacity RAM card, a read-only one such as a CD-ROM is also applicable. However, in the case of a CD-ROM, it is not assumed that the user will write the data by himself. The computer main body 7 is for controlling the above-mentioned device group and performing data processing, and is composed of a CPU, a memory and the like. Further, an external device control device 9 for controlling an external device is incorporated in the multimedia device. This multimedia device includes each of the above device groups, and
There is also provided a communication means 8 which can be connected to an SDN line or a general public line to exchange data with a remote place. External devices to be controlled by the computer main body 7 include audiovisual devices such as video cameras, videotape recorders, TV receivers, laser disks, and audio sets, communication means such as facsimiles and telephones, lighting equipment, and air conditioning. Examples include home control devices such as devices, crime prevention devices, and simple medical diagnostic devices. Further, the control contents include turning on / off the power of the device, monitoring the operating state, and changing the operation contents. These control contents are defined by programming data written in the recording device 6 in the form of text-related information corresponding to each job.

The outline of the file integrated management method of the present invention proposed on the assumption of application to such a multimedia device is shown in FIGS. 2 and 3. Here, VISU
AL. V1 video file and AUDIO. A2 audio file, TEXT. An example is given in which a text-related file T3 is created and these are recorded and reproduced. The extensions V1, A2, and T3 attached to each file mean that the recording / reproducing method of each file is the V1, A2, or T3 method.

The video file (VISUAL.V1) is created by the video input from the input device 3, the audio file (AUDIO.A2) is created by the audio input from the input device 4, and the text related file (TE.
XT. T3) is created by inputting text-related information from the input device 5. According to the present invention, when recording each file related to video, audio, and text on a recording medium, FIG.
As shown in, the above three files are data-combined after solving the respective file forms while maintaining the file block (the chunk of the original file), and further, at the beginning of the combined file, the video, audio and text related One integrated file (TOUGOU.TO1) is created by adding file control data that defines the division position of each file and the reproduction timing of each file. Video, audio, and text related files may be integrated as they are while maintaining the file size or may be compressed. The embedding position of the file control data does not necessarily have to be the beginning of the integrated file.

The integrated file created (TOUGOU.
The TO1) is integrated with the video file portion, the audio file portion, and the text-related file portion clearly separated from each other, and the file control data is added to the head thereof. In this state, the file names of the video, audio, and text-related file parts have been removed, but the original file name of each file must be embedded in the integrated file so that the original file name can be restored during the playback operation described later. Is preferred. The file control data is used to synchronously reproduce the storage position (dividing position) of each video, audio, and text-related file portion in the integrated file and the data stored in each video, audio, and text-related file portion. Data that defines the reproduction timing is recorded. The integrated file (TOUGOU.TO1) created in this way is recorded in a recording medium such as MO, MD, or HDD.

Next, when the recorded integrated file is reproduced, as shown in FIG. 3, the integrated file (TOUGOU.TO1) is first read from the recording medium onto the memory (RAM) of the computer main body. Next, this integrated file is divided into three on the memory based on the file dividing position information recorded in the control data stored at the beginning of the integrated file, and the integrated file (TO
UGOU. Video file (VISUAL.
V1), audio file (AUDIO.A2) and text related file (TEXT.T3) are restored. Integrated file (TOUGOU.TO
When each file portion stored in 1) is in a compressed file format, decompression may be performed at the same time as restoration. The three independent video, audio and text related files restored on the memory are synchronized with the data in the video, audio and text related files by referring to the reproduction timing information included in the control data. Meanwhile, the video information and the text related information are displayed on the display device 1, and the audio information is reproduced by the audio reproduction device 2 in correspondence with the displayed contents.

FIG. 4 shows another embodiment of the present invention, in which the video data in the integrated file is recognized while the integrated state is maintained and the boundaries between the files are recognized without separating the three independent files from the integrated file. , Direct access to voice data and text related data.

As described above, the embodiment of the present invention is applied to the video file (V
ISUAL. V1), audio file (AUDIO.A
2) and the text-related file (TEXT.T3) have been described based on the fictitious recording / reproducing system, but actually, as the video file, a moving image compression file such as an MPEG file, a still image compression file such as a BMP file or a GIF file, etc. MIDI files, WAV files and various PCM files are used as audio data recording / reproducing methods, and EBCDIC is used as text-related data.
Code or ASCII code is adopted.

Next, an example of an application to which the integrated file management method of the present invention is applied will be described. FIG. 5 illustrates the operation procedure of the application according to the screen display, and FIGS. 6 to 8 are flowcharts showing the processing contents associated with the operation. This application activates a moving image starting from the "title screen" by selecting a desired item from a plurality of "title screens" that are divided and displayed in a window format on the initial screen (home menu), and is required. It outlines the usage pattern for controlling an external device connected to the multimedia device according to the above, specifically, "product introduction in mail order", "digest version library of home video", " A library of the main news of the day ",
A variety of usage patterns are conceivable, such as application to "travel guides provided by travel agencies" and "personal introduction provided by dating agency".

In this application, first, a plurality of title images represented by still images are displayed in a list on the initial screen. When a title to be activated is selected and executed, the title image fills the screen. It is constructed such that the moving image starting from the title video is reproduced together with the audio information and the text related information while being zoomed up.

For example, as shown in FIG. 5, a still image of a lion with the title "Travel in Africa" added to the home menu 100, which is the initial screen, and "Japan-US trade negotiations".
Still image of the US and Japanese flags with the title
Image of a telephone with the title "Fax"
Suppose that the still images of the fax with the title are displayed in a list, and when the still image of the lion is selected, the moving image starting from the still image of the lion starts and the narration starts, and the bottom column of the screen is displayed. The explanation corresponding to the scene is displayed. When a still image of both Japanese and American flags is selected, a news moving image of Japan-US trade negotiations starting from the still image of both Japanese and American flags and its commentary are made by voice and characters written on the screen. Furthermore, if you select a still image of a telephone or fax, a moving image showing how to make a call or send a fax starts to move.
In addition, the telephone or fax connected externally to the multimedia device can be controlled to make a call using the voice input device of the multimedia device, or the document stored in the recording device of the multimedia device can be stored. To send. The data to be transmitted is not limited to audio, and it may be considered to transmit video. It is also possible to provide a job for transmitting data in a recording medium such as an FDD with the same ease as fax transmission. As described above, the contents of the jobs displayed in the form of the title video are various, the genres and the processing contents are also various, and there are those with or without external device control. The operation of selecting these different jobs is similar to selecting a TV program, and can be easily operated. The data group essential for executing different jobs is collectively recorded in the recording medium in the form of an integrated file, so that data management is easy.

An example of the operation method and processing procedure of this application will be described below. In the following description, selection of the corresponding item on the screen is usually performed by moving the cursor to the selected position by mouse operation and then clicking, but other selection methods are also adopted as appropriate, for example, keyboard operation or Selection by pressing operation on touch panels stacked on the display screen is also included.

The operation mode of this application is shown in FIG.
As shown in the flowchart of FIG. 8, the "edit mode",
It is roughly divided into "playback mode" and "communication mode".
The outline of each mode will be described below with reference to FIGS.

First, when the system is started, the home menu 100 is displayed on the screen. Home menu 10
0 indicates titles 101 and 10 represented by still images.
1, ... are displayed in parallel in a window format in parallel. The title 101 is automatically created based on the image at the beginning of the video file which is a moving image file, and the title is attached to the lower column of the title 101. In the lower section of the screen, a "communication mode" selection section 102 is provided. In this embodiment, the “communication mode” selection field is provided in the home menu 100, but it may be provided in any menu screen other than the home menu. An empty space in the title where no image is displayed indicates that no data is registered there.

When a specific title is selected from the listed titles, the integrated file corresponding to the title is called. Then, the title screen is enlarged and displayed on the full screen, and the reproduction & edit menu 200 is displayed. On the other hand, if a blank space is specified in the home menu 100, the new creation menu 300 is directly displayed.

In the play & edit menu 200, a full size display button 201 for the image, a home menu return button 202, a play button 203, a fast forward button 204, a rewind button 205, and a pause button 2 are displayed on the side of the image.
06, a button 207 for shifting to the input edit mode is displayed. When the full size display button 201 is selected, the screen display becomes the full size display screen 400, and when the mouse button is clicked on the full size display screen 400, the screen returns to the original screen. Play button 203
Select or click the mouse on the still image, the corresponding integrated file will be read from the recording medium, the moving image starting from the currently displayed still image will be started and the audio will start, and if necessary, Text-related information is displayed in duplicate on the screen. Also, fast forward, rewind, pause, etc. are performed by operating other buttons.
The current reproduction elapsed time is indicated by changing the bar graph 208 displayed at the upper position of the image.

As described above, the processing procedure when the reproduction desired title is selected from the home menu 100 and the moving image accompanied by the voice and text related information is reproduced is shown in the flowchart of FIG. That is, prior to displaying the home menu 100, the MO or M that is the read destination of the file.
A recording medium such as D or HDD is selected, and one screen of the video image of the first part of the video files of all integrated files stored in the recording medium in the form of a compressed file or the like is reduced and displayed as a list (title display). To do. Next, when the title to be played back is specified by operating the mouse etc., the target integrated file is read from the recording medium to the memory of the computer main body, the compression is decompressed in the memory and the video file, audio file, text Separated into related files. The data of the separated video file and text related file is reproduced by the display device, while
The data of the audio file is reproduced by the audio reproducing device while synchronizing the timing with the video data. File control data (not shown) is referred to when separating the reproduction timing and the integrated file.
The computer main body constantly monitors the command input state from the mouse or keyboard while reproducing each data of video, audio and text, and executes the command when the command input is accepted.

Next, the input edit mode will be described. The shift to the input edit mode is executed when the shift button 207 to shift to the input edit mode is selected in the reproduction state or when the title is blank in the home menu 100. In the reproducing state, when the transition button 207 to the input edit mode is selected at an arbitrary position, the edit menu 500 is displayed. When the playback button 503 is selected on this menu screen to play back the moving image and the scene to be edited is reached, the pause button 5 is pressed.
By selecting 06 to stop the image and then selecting the record / record button 508, the contents of that portion can be changed. Since the processing procedure for input editing is the same as the processing procedure for input editing by the new creation menu 300, the processing procedure for newly creating a file will be described here as an example.

FIG. 6 is a flow chart showing an example of the processing procedure when a new integrated file is created in the edit mode. When entering the new creation mode, it is first designated whether or not the one to be input is accompanied by audio information, and then designated whether or not accompanied by video. When the designation of the presence / absence of audio and video is completed, video capture by the video input device and voice capture by the audio input device are performed, and a video file and an audio file are created. Various types of video input devices and audio input devices can be adopted. When the input of video information and audio information is completed, the presence or absence of text related information is specified, and if there is text related information, the text related information is input using the keyboard or superimposing device to create a text related file. To do. In this way, if all the video files, audio files, and text-related files are prepared, these files are combined to create an integrated file. In addition to the video file, the audio file, and the text-related file, the integrated file is added with control data that defines the dividing position of each of these files and the reproduction timing of each file. The integrated file is stored in the recording medium after being compressed or the like to reduce the file size.

The integrated file thus stored or reproduced in the recording medium can be distributed by hand, by mail, or by delivery by downloading it to the FD, MD, MO or the like. Further, by selecting the "communication mode", the integrated file can be transmitted to the remote place or the integrated file can be received from the remote place. The flowchart shown in FIG. 8 shows an example of a processing procedure in the “communication mode”. The communication may be between individuals, or may be communication with the center. The center function is preferably carried out by an organization that stores a large number of integrated file libraries. For example, an organization that stores various TV programs and movies in the form of an integrated file proposed by the present invention is assumed. T
The V broadcasting station can also take on the function. Although the transition button to the "communication mode" is provided separately from the title video on the initial screen here, the "communication" itself can be regarded as one job. In this case, for example, a title image suggesting communication is added as one of the jobs displayed on the home menu 100, and communication is performed according to the programming data written in the text related data of the integrated file when this title image is selected. Can be implemented. Further, by writing programming data for controlling various external devices in the text-related data, it is possible to construct a system in which a predetermined operation of the external device is performed only by selecting a title video.

As can be seen from the above-described embodiments, the application range of the present invention is diverse. For example, "product introduction in mail order", "library of digest version of home video", "library of major news of the day", "travel guide provided by travel agencies", "person provided by dating agency" Various usage forms are possible such as application to "introduction".

For example, as an application of the "home video digest version library", "preparation of a memorial MD at a wedding ceremony" can be considered as a more specific example. For example, a video of each scene at a wedding is taken, the video and audio recorded on this videotape are input to a multimedia device for editing, and a moving image with audio for each scene is regarded as one job. However, "Admission", "Cake cutting", "Relative greeting", "Friend greeting" for each scene
By inputting the titles such as "" by kana-kanji conversion from the keyboard, an image database is displayed in which a list of title videos with the above-mentioned titles is displayed on the initial screen. Then, a data group forming each job of this image database is stored in the HDD or the like in the form of an integrated file. At a later date, the data in this image database will be copied from the HDD to an MD or the like and distributed to persons concerned. The person who receives the MD plays this image database on the multimedia device at home,
If you select, for example, a "Cake Cut" job from the title images listed on the initial screen, the title image will expand to fill the screen and a moving image that starts from the title image will start with sound or tickers. However, the appearance of "cake cutting" is reproduced with a sense of reality. This usage pattern is similar to turning an album, and can be expected to be used as an alternative to the album.

Further, the following usage mode is conceivable as a usage mode of "library of main news of the day". For example, news programs have a fixed broadcast time slot, so if a worker returning home late at night wants to know what happened on that day, he must wait until the next broadcast time slot, and in the worst case, wait until the next morning. Sometimes it doesn't. To avoid this, it is conceivable to make a video recording reservation with a video tape recorder, but the video recording recorder is troublesome, and in the video tape recorder, it is necessary to skip by fast-forward to find a desired part, which is troublesome. Most of the time, you don't want to see all the news, only the ones you are interested in, so you can view the news as "politics,""economy,""society,""sports," etc. It wouldn't be more convenient if an image database classified by genre is provided. For example,
If the TV broadcasting station establishes a news library production and supply center, and this center produces a library that divides the news of the day by genre and can supply this to viewers through communication lines, it will be late at night. The worker who came home can operate the multimedia device at home to access the center and select the desired title video from the news title videos by genre listed on the screen, and the news of the genre he wants to watch at any time It can be easily obtained. If the news information obtained in this way is stored in the HDD, MD, MO in the form of an integrated file, a scrap collection relating to the theme of which one is interested can be obtained.

[0041]

According to the file integrated management method of the present invention, when recording a file, each independently present video, audio, and text-related file is divided into respective file division positions and respective files. In addition to adding control data that specifies the playback timing of each file,
Since it was decided to combine the data while maintaining the respective file blocks into a single integrated file and record them on the recording medium, the data related to video, audio and text related to the single integrated file is stored in the recording medium. Since it can be handled as a file, it is not necessary for the application side to manage the correspondence relationship between each data related to video, audio and text. In addition, there is no possibility that only one of the video, audio, and text related data will be lost or damaged, so the application side said, "Inconsistency has occurred between the video, audio, and text related data. It is not necessary to incorporate "procedures for dealing with cases" and the like, and the burden of file management on the application side can be reduced.

Further, before recording on the recording medium or in a state of being read from the recording medium, each data related to video, audio and text has an independent file format. Replace specific files without affecting other files, such as replacing contents or replacing the recording / playback method of video files without affecting audio files and text-related files for the purpose of enhancing the functionality of applications. Because it is easy, the degree of freedom in designing an application is increased. And in the future,
When a better recording / reproducing system is developed, it is easy to shift to this new recording / reproducing system.

[Brief description of drawings]

FIG. 1 is an explanatory diagram showing an example of a multimedia device to which the method of the present invention is applied.

FIG. 2 is an explanatory view showing a process of recording video, audio, and text-related data on a recording medium in an embodiment of the method of the present invention.

FIG. 3 is an explanatory diagram showing a process of reproducing video, audio, and text-related data from a recording medium in an embodiment of the method of the present invention.

FIG. 4 is an explanatory view showing a process of reproducing video, audio and text-related data from a recording medium in another embodiment of the method of the present invention.

FIG. 5 is an explanatory diagram showing an example of a screen display in an application example of the file management method according to the present invention.

FIG. 6 is a flowchart showing an example of a processing procedure of an edit mode in the application example.

FIG. 7 is a flowchart showing an example of a processing procedure of a reproduction mode in the application example.

FIG. 8 is a flowchart showing an example of a processing procedure of a communication mode in the application example.

FIG. 9 is an explanatory diagram showing that there are many different recording / reproducing systems for each of video, audio, and text.

FIG. 10 is an explanatory diagram showing that there may be various combinations of recording / reproducing systems related to video, audio, and text depending on the application.

FIG. 11 is an explanatory diagram showing that different data exist in response to a large number of different recording / reproducing systems for each of video, audio, and text.

FIG. 12 is an explanatory diagram of an example of a conventional recording / reproducing system for each data related to video, audio, and text.

FIG. 13 is an explanatory diagram of another example of the conventional recording / reproducing system for each data related to video, audio, and text.

FIG. 14 is an explanatory diagram of another example of a conventional recording / reproducing system of each data related to video, audio, and text.

[Explanation of symbols]

1 Display Device 2 Audio Playback Device 3 Video Information Input Device 4 Audio Information Input Device 5 Text Related Information Input Device 6 Recording Device 6a Recording Medium 7 Computer Main Body 8 Communication Means 9 External Device Control Device

Claims (2)

[Claims] 1. Video information represented by still images and moving images,
A display device that displays text-related information represented by characters and symbols, an audio reproduction device that reproduces audio information represented by music and voice, and inputs each data of the video information, text-related information, and audio information. An input device, a recording device for recording video data, audio data and text-related data input through the input device, and a computer main body for controlling the display device, the music reproducing device, the input device and the recording device to perform data processing In a multimedia system equipped with and, control data is added to independently exist video data files, audio data files, and text-related data files, and to define the division position of each file and the playback timing of each file. In addition, each file block is When the data are combined into one integrated file and recorded on a recording medium and then reproduced, the integrated file is converted into a video data file portion and an audio data file based on the division position information of the file recorded in the control data. The part and the text related data file are divided and taken out to restore the video data file, the audio data file and the text related data file, and the reproduction timing information included in the control data is referred to, and the video information, the text related information and the sound are recorded. A method for integrated management of video, audio, and text-related data files characterized by reproducing information. 2. Image information represented by still images and moving images,
A display device that displays text-related information represented by characters and symbols, an audio reproduction device that reproduces audio information represented by music and voice, and inputs each data of the video information, text-related information, and audio information. An input device, a recording device for recording video data, audio data and text-related data input through the input device, and a computer main body for controlling the display device, the music reproducing device, the input device and the recording device to perform data processing In a multimedia system equipped with, the video data file, audio data file, and text-related data file that exist independently are added with control data that defines the division position of each file and the playback timing of each file. In addition, data is maintained while maintaining each file block. When recorded and recorded on a recording medium as one integrated file together, the integrated file is used to record a video data file part, an audio data file part and an audio data file part based on the file division position information recorded in the control data. Directly access each data file part of the integrated file while recognizing the boundary between each text file related data file part, and refer to the playback timing information included in the control data to obtain the video information, text related information and audio information. An integrated management method of video, audio, and text-related data files characterized by reproducing.