JP2004104212A - Band management file system apparatus, program thereof, and program recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a band management file system apparatus wherein a device such as a nonlinear edit device and a video server needing a file access to warrant real time performance can read / write a moving picture without interruption to enhance the reliability. <P>SOLUTION: The file system apparatus designates priority of disk accesses, executes access depending on the priority, warrants a band for an access such as video and audio access wherein real time performance is a requirement and improves access performance at division of data blocks by a buffer function so as to realize recording and reproduction of high quality video and audio. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a file system device relating to a non-linear editing machine / video server that handles video / audio requiring real-time properties, a program for its operation, and a program recording medium recording the program.
[0002]
[Prior art]
As a computer-based video device using a file, there is a non-linear editing machine, a video server, and the like. The conventional technology will be described by taking the non-linear editing machine shown in FIG. 8 as an example. As shown in the figure, a conventional nonlinear editing machine 801 includes a video / audio data storage unit 802, and a nonlinear application 803 generally includes a data interface unit 805 such as SCSI through a file system 804 such as FAT or NTFS. To the data storage unit 802 connected to the PC and outputs an image on the GUI or to the NTSC monitor 806 connected separately.
[0003]
[Problems to be solved by the invention]
However, since there is an upper limit on the access band of the disk, when a large number of access requests are generated, the bandwidth per disk is reduced. Further, for example, when exchanging files via a network, the data is divided into small pieces, and the substantial bandwidth at the time of access is reduced.
[0004]
On the other hand, the file system of the conventional nonlinear editing machine is not designed to maintain the real-time property of video and audio, and processes the access commands in the order in which they are received. When another access that does not require the quality is performed, the video cannot be processed preferentially, or the access to the small divided data causes the real-time performance to be lost and the image quality to drop such as dropped frames. Could occur.
[0005]
[Means for Solving the Problems]
According to a first aspect of the present invention, there is provided a data storage unit that stores a file, a file system that manages data allocation information by associating logical blocks of the file with physical blocks, a data interface unit to the data storage unit, A means for setting a bandwidth when the application accesses the file, and a deadline indicating a time when the application should complete access to the file based on the bandwidth. And a means for controlling access to the file based on the deadline. ", Whereby a high-priority request is issued within a time specified by the application. Video and audio. For the data required for the real-time, it is possible to record and reproduce high-quality video and audio.
[0006]
According to a second aspect of the present invention, there is provided a data storage unit that stores a file, a file system that manages data arrangement information by associating logical blocks of the file with physical blocks, a data interface unit to the data storage unit, A means for setting one or more applications for accessing the file, a means for setting a priority when the application accesses the file, a means for distributing the priority to an access storage column based on the priority, A bandwidth management file system device having means for controlling access to the file. ", Whereby it is possible to process requests with high priority with priority, High-quality recording and playback of video and audio for data that requires real-time performance
[0007]
According to a third aspect of the present invention, there is provided a data storage unit that stores a file, a file system that manages data arrangement information by associating logical blocks of the file with physical blocks, a data interface unit to the data storage unit, A means for setting a bandwidth when the application accesses the file, and a deadline indicating a time when the application should complete access to the file based on the bandwidth. Means for controlling access to the file based on the deadline, means for setting a priority when accessing the file, and means for distributing to a priority-based access storage column based on the priority, Control access to the file based on priority Bandwidth management file system device characterized by having a stage. "This makes it possible to preferentially process a high priority request using the priority and deadline specified by the application, It is possible to record and reproduce high-quality video and audio for data requiring real-time properties such as video and audio.
[0008]
According to a fourth aspect of the present invention, there is provided a data storage unit that stores a file, a file system that manages data arrangement information by associating logical blocks of the file with physical blocks, a data interface unit to the data storage unit, When the application writes data to the file, the data is temporarily stored in a memory buffer when the size of the data is equal to or less than a certain value, and the data is temporarily stored in a memory buffer when the application writes data to the file. A band management file system apparatus characterized in that the file is written in the file. This makes it possible to write data in a large size, and to write data that requires real-time properties such as video and audio. enable.
[0009]
Further, a fifth or sixth invention of the present invention is directed to "the execution of all or a part of the function of each means or each part of the bandwidth management file system according to any one of the first to fourth inventions by a computer. Characteristic program, or a program recording medium on which this program is recorded. "
[0010]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an embodiment of a bandwidth management file system device according to the present invention will be described with reference to the drawings.
[0011]
(1st Embodiment)
FIG. 1 is a block diagram showing the configuration of the bandwidth management file system device according to the first embodiment of the present invention.
[0012]
In FIG. 1, reference numeral 801 denotes a non-linear editing machine, 102 denotes a file system, 802 denotes a data storage unit, 803 denotes an application having a non-linear editing function, and 805 denotes a data interface unit. Normally, the data storage unit 802 includes one or more disks, and the data interface unit 805 includes a card having an interface such as SCSI.
[0013]
FIG. 2 shows a configuration of the file system 102 in the present embodiment. In FIG. 2, reference numeral 201 denotes a command queue storage unit for storing a file access command from an application. Reference numeral 202 denotes a command queue for storing the file access command.
[0014]
A deadline calculation module 203 calculates a deadline for a file access command issued from an application. Reference numeral 204 denotes a command storage thread that sorts and stores file access commands to which a deadline has been assigned in the command queue 202 from the shorter deadline.
[0015]
Reference numeral 205 denotes a scheduling thread for processing a command to be processed in the current time slot in the command queue 202, if any. Reference numeral 206 denotes a timer for performing time slot processing. Reference numeral 207 denotes an acquisition module for acquiring a file access command in a current time slot from a command queue. A file access command issuing module 208 issues a file access command to the disk. Reference numeral 209 denotes a file access command issued by the application 803 to the file system 102.
[0016]
The file system 102 provides an application with a function of setting and acquiring a band for accessing each file as one of the attribute information of each file. The application can set the bandwidth for the file using this function. When the application issues a file access command, the command is first processed by the deadline calculation module 203. The deadline calculation module 203 calculates a deadline based on the past processing time issued by each application and the bandwidth set for the file to be accessed.
[0017]
A deadline calculation method performed by the deadline calculation module will be described with reference to FIG. When accessing a file for which an access bandwidth of 10 Mbps is set with an access block of 1 MB, it is necessary to access at an average of 836 msec. However, the deadline length changes as shown in FIG. 3 depending on the time (Req) for accessing the file. For example, Req2 is longer than 838 msec because the file access command is issued earlier, and Req3 is a negative number because Req3 is issued later.
[0018]
The command storage thread 204 stores the file access command 209 added with the deadline calculated by the deadline calculation module 203 in the command queue 202. The scheduling thread 205 uses the acquisition module 207 to determine whether there is a command to be processed in the current time slot, and sends a file access command 209 to the file access command issuing module 208 when the acquisition module 207 determines that the command should be acquired. I do.
[0019]
The timer 206 is a functional block that issues a timer event at regular intervals and passes control to the next module.
[0020]
How the file access command issuing module 208 issues a file access command will be described with reference to FIG. Here, the deadlines of the file access commands A1, A2, and A3 stored in the command queue 202 are 5, 15, and 25, respectively. The length of the time slot shown in FIG.
[0021]
The timer 206 passes control to the acquisition module 207 at 10 intervals.
[0022]
As shown in FIG. 4, the file access commands A1, A2 and A3 issue a file access command for each time slot.
[0023]
By such a process, it becomes possible to process a request with a high priority preferentially. In the nonlinear editing machine of the present embodiment, for data requiring real-time properties such as video and audio, Requests are processed preferentially, and high-quality video / audio recording / reproduction becomes possible.
[0024]
(Second embodiment)
FIG. 5 is a block diagram showing the configuration of the bandwidth management file system device according to the second embodiment of the present invention. In FIG. 5, reference numeral 501 denotes a command distribution module that distributes the file access command 209 according to the priority (Priority) of the file access command 209. 502 is a high priority command queue, 503 is a low priority command queue, and 504 is a non-priority command queue. Reference numeral 505 denotes an acquisition module for the high-priority command queue 502, reference numeral 506 denotes an acquisition module for the low-priority command queue 503, and reference numeral 507 denotes an acquisition module for the non-priority command queue 504.
[0025]
In FIG. 2, an application can issue a file access command in a priority mode and a normal mode. The high-priority command queue 502 and the low-priority command queue 503 respectively store write and read commands for file access with a priority mode specified by the application. On the other hand, the non-priority command queue 504 stores access commands for which a normal mode is specified. When the application opens a file, it specifies the access mode as priority or normal. Incidentally, in the normal case, the operation is the same as that of the conventional file system.
[0026]
Next, an operation when an access request 209 is received from an application will be described. The command distribution module 501 in the command storage thread 204 stores the file access command 209 in the corresponding command queue 502 depending on whether the file access command 209 is written in the priority mode, read in the priority mode, or read / write in the normal mode. , 503, 504.
[0027]
Each of the command queues 502, 503, and 504 checks the file access command actually stored in each of the command queues 502, 503, and 504 according to the time slot number N. The time slot number N increases by one each time the time slot interval elapses, such as time slot 0 and time slot 1 shown in FIG. Here, the following processing is performed using the remainder M obtained by dividing the time slot N by 6. The timer 206 is a functional block that issues a timer event at regular intervals and passes control to the next module.
[0028]
{Circle around (1)} If M is 1, 3 or 5, and the file access command 209 is in the high priority command queue 502, the file access command 209 is passed to the file access command issuing module 208, and the next time slot is set to the timer 206. Wait at. Otherwise, execute (2).
[0029]
(2) If M is 2 or 4 and the file access command 209 is in the low priority command queue 503, the file access command 209 is passed to the file access command issuing module 208, and the next time slot is waited for by the timer 206. . Otherwise, execute (3).
[0030]
(3) If the file access command 209 exists in the non-priority command queue 504, the file access command 209 is passed to the file access command issuing module 208. If not, the next time slot is waited for by the timer 206.
[0031]
By such a process, it becomes possible to process a request with a high priority preferentially. In the nonlinear editing machine of the present embodiment, for data requiring real-time properties such as video and audio, Requests are processed preferentially, and high-quality video / audio recording / reproduction becomes possible.
[0032]
(Third embodiment)
FIG. 6 is a block diagram showing the configuration of the bandwidth management file system device according to the third embodiment of the present invention. Here, points different from the second embodiment described above will be described. FIG. 6 shows a deadline calculation module, whose function is the same as that described in the first embodiment. Reference numeral 601 denotes an acquisition module for the high-priority command queue 502, 602 denotes an acquisition module for the low-priority command queue 503, and 603 denotes an acquisition module for the non-priority command queue 504. Each of the acquisition modules 601, 602, and 603 is different from each acquisition module in the second embodiment in that each of the acquisition modules 601, 602, and 603 in the present embodiment has a deadline next to the file access command 209. The point is that a file access command 209 for determining whether or not to process by the coming time slot and determining to process by the next time slot is passed to the file access command issuing module 208. Since the file access command 209 stored in the non-priority command queue 504 does not have a deadline, the acquisition module 603 for the non-priority command queue 504 does not need to see the deadline.
[0033]
The algorithm of these acquisition modules 601, 602, 603 is described below.
[0034]
{Circle around (1)} M is 1, 3 or 5, and there is a file access command 209 in the high-priority command queue 502, and its deadline is the next time slot to be transferred to the acquisition module for the high-priority command queue 502. If the processing should be completed before this, the file access command 209 is passed to the file access command issuing module 208, and the next time slot is waited for by the timer 206. Otherwise, execute (2).
[0035]
{Circle around (2)} M is 2 or 4, and there is a file access command 209 in the low-priority command queue 503, and the deadline of the file access command 209 is reached by the next time slot to be transferred to the acquisition module for the low-priority command queue 503 If it should be processed, the file access command issuance module 208 passes the file access command 209 and waits for the next time slot by the timer 206. Otherwise, execute (3).
[0036]
(3) If the file access command 209 exists in the non-priority command queue 504, the file access command 209 is passed to the file access command issuing module 208. If not, the next time slot is waited for by the timer 206.
[0037]
As described above, while a request with a high priority is processed preferentially, other low-priority requests can be processed using an available band without occupying a band more than necessary. The non-linear editing machine in the example guarantees the bandwidth for data that requires real-time performance such as video and audio, and maintains the high quality of video and audio even when normal file access occurs. Recording and reproduction become possible.
[0038]
(Fourth embodiment)
FIG. 7 is a block diagram showing the configuration of the bandwidth management file system device according to the fourth embodiment of the present invention. In FIG. 7, reference numeral 701 denotes a user buffer for write data held inside the application, and 702 denotes a kernel buffer for write data held inside the application.
[0039]
When a file write command is received from the application 803, the file system 502 compares the data with a predetermined data size, and when requested to write data of a larger size, as shown by 703, The contents of the user buffer 701 in the application are written directly to the data storage unit 802. On the other hand, if a request is made to write data of a size smaller than the predetermined data size, the file system copies the contents of the user buffer 701 to the kernel buffer 702, as shown at 704, and finishes writing to the application 803. Notify.
[0040]
If a request to write to the next address is received without the file being closed, the copy of the write data is repeated 704 to the previous continuation address in the kernel buffer 702, and when the buffer becomes full, the data to the disk is actually read. Write 705 is performed. When a request to close the file is made, the contents of the buffer are immediately written to the disk (705), and then the close process is executed.
[0041]
By such a process, writing of a large data size can be speeded up by omitting copying between buffers, while, for example, when data is written via a network, small data is repeatedly written. By reducing the overhead generated by writing to a disc and maintaining the performance, high-quality recording of frames such as video and audio can be performed without dropping frames.
[0042]
In the first to fourth embodiments, SCSI is used as an interface for connecting the data storage unit. However, any other interface that can be connected to a hard disk, such as IEEE1394, USB, fiber channel, or IDE, can be similarly realized. In the second and third embodiments, the priority is set to three levels, but the same effect can be obtained if the priority is plural. Also, the commands to be stored are not limited to the priorities of this embodiment.
[0043]
【The invention's effect】
Since the bandwidth management file system apparatus of the present invention can manage file access in consideration of real-time property at the time of file access, a device that requires file access that guarantees real-time property such as a non-linear editing machine or a video server Can read and write the video without interruption, and can improve its reliability.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a bandwidth management file system device according to a first embodiment of the present invention; FIG. 2 is a diagram illustrating a configuration of a file system of the bandwidth management file system device according to the first embodiment of the present invention; FIG. 4 is a diagram showing a method of calculating a deadline of the bandwidth management file system device according to the first embodiment of the present invention. FIG. 4 issues a file access command to the disk of the bandwidth management file system device according to the first embodiment of the present invention. FIG. 5 is a diagram showing the timing of the operation. FIG. 5 is a diagram showing the configuration of the file system of the bandwidth management file system device according to the second embodiment of the present invention. FIG. 6 is an illustration of the bandwidth management file system device according to the third embodiment of the present invention. FIG. 7 shows a configuration of a file system. FIG. 7 shows a configuration of a bandwidth management file system device according to the first embodiment of the present invention. Figure 8 is a configuration diagram of a conventional example [Description of symbols]
102 File system 201 Command queue storage unit 202 Command queue 203 Deadline calculation module 204 Command storage thread 205 Scheduling thread 206 Timer 207 Acquisition module 208 File access command issuing module 209 File access command 501 Command distribution module 502 High priority command queue 503 Low Priority command queue 504 Non-priority command queue 505 Acquisition module 506 for high priority command queue 502 Acquisition module 507 for high priority command queue 502 Acquisition module 601 for high priority command queue 502 Acquisition module for high priority command queue 502 602 Acquisition module 603 for high priority command queue 502 High priority For command queue 502 acquisition module 701 the user buffer 702 kernel buffer 801 the non-linear editing apparatus 802 data storage unit 803 nonlinear application 804 prior file system 805 SCSI Drivers & card 806 NTSC monitor

Claims (6)

A data storage unit that stores a file, a file system that manages data arrangement information by associating logical blocks of the file with physical blocks, a data interface unit to the data storage unit, and one or more of accessing the file Means for setting a bandwidth when the application accesses the file; means for calculating a deadline indicating a time when the application should complete access to the file based on the bandwidth; and Means for controlling access to the file based on a line. A data storage unit that stores a file, a file system that manages data arrangement information by associating logical blocks of the file with physical blocks, a data interface unit to the data storage unit, and one or more of accessing the file Means for setting a priority when the application accesses the file, a means for allocating the priority to an access storage column based on the priority, and controlling access to the file based on the priority. And a bandwidth management file system device. A data storage unit for storing a file, a file system for managing data allocation information by associating logical blocks of the file with physical blocks, a data interface unit to the data storage unit, and one or more of Means for setting a bandwidth when the application accesses the file, means for calculating a deadline indicating a time when the application should complete access to the file based on the bandwidth, and Means for controlling access to the file on the basis of: means for setting a priority when accessing the file; means for allocating to a priority-based access storage column based on the priority; and Have a means to control file access Band management file system and wherein the. A data storage unit that stores a file, a file system that manages data arrangement information by associating logical blocks of the file with physical blocks, a data interface unit to the data storage unit, and one or more of accessing the file When the application writes data to the file, the application temporarily stores the data in a memory buffer when the size of the data is smaller than a certain value, and writes the data to the file when the buffer is full. A bandwidth management file system device comprising: A program for causing a computer to execute all or a part of functions of each unit or each unit of the bandwidth management file system according to any one of claims 1 to 4. 5. A program recording medium on which is recorded a program for causing a computer to execute all or a part of the functions of each means or each part of the bandwidth management file system according to claim 1.

Images