JP4109367B2 - Non-linear video editing apparatus and method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a non-linear video editing apparatus, and more particularly, to a change in sampling rate of audio data.
[0002]
[Related technologies]
Today, DV (digital video) nonlinear video editing is attracting attention. In this method, a DV video signal is stored in an HDD (hard disk) of a personal computer via a video capture board, an arbitrary frame is taken out, and an image is edited.
[0003]
Such editing processing will be briefly described. DV data as shown in FIG. 6A is captured from a digital video (DV) camera DV device connected via an IEEE 1394 interface (not shown). This digital data is stream data composed of a plurality of frames. Each frame is composed of DV-compressed video data and audio data digitized at a predetermined sampling rate.
[0004]
As shown in FIG. 6B, the DV video capture board separates video data and audio data for each frame. The separated video data and audio data are stored in the hard disk as stream data in which each frame is continued.
[0005]
When a display command is given from the operator, the video data stored in the hard disk is decompressed and an image of a predetermined frame is displayed on the monitor. The operator looks at the displayed image and performs desired editing, for example, deleting the seventh frame image. As a result, the audio data corresponding to the seventh frame is also deleted. Such audio data deletion is executed as follows. Since the sampling rate of the audio data is determined in advance, the average number of samples corresponding to one frame can be obtained. Since the average position of the audio data corresponding to the image of the seventh frame is determined by this average number of samples * 6, the audio data corresponding to one frame may be deleted from that position.
[0006]
[Problems to be solved by the invention]
However, the nonlinear video editing apparatus has the following problems. Depending on the DV video camera, the sampling rate of the audio data may be slightly different from a predetermined sampling rate. For example, when the sampling rate is higher than a predetermined rate, the data amount per frame becomes large as shown in FIG. 6C. However, in the editing operation, the position of the audio data corresponding to the video frame to be edited is determined based on the predetermined rate, specifically, the number of audio data per video frame. Therefore, the audio data to be edited is shifted. On the other hand, when the sampling rate is lower than the predetermined rate, the data amount per frame becomes small as shown in FIG. 6D. Therefore, also in this case, a problem of deviation occurs. Such a shift between video and audio is a problem in video editing.
[0007]
The nonlinear video editing also has the following problems. Depending on the DV video camera, the sampling rate of the audio data can be switched in one tape. In this case, the sampling rate differs for audio data from the middle, and the audio data cannot be taken into the hard disk and stopped, or even if the data is taken in, it is stored silently.
[0008]
The present invention solves the above-described problem, and in digital stream data in which video data and audio data are interleaved, video data and audio data are accurately associated with each other in a storage medium regardless of fluctuations in the sampling rate of the audio data. It is an object of the present invention to provide a digital data storage device or method thereof that can be stored.
[0009]
In addition, non-linear video editing apparatus capable of non-linear video editing by accurately associating video data and audio data with respect to digital stream data in which video data and audio data are interleaved regardless of fluctuations in the sampling rate of the audio data. Another object is to provide a method thereof.
[0010]
[Means for Solving the Problems and Effects of the Invention]
In the nonlinear video editing apparatus according to the present invention, when 1) the mixed stream digital data is given, separate storage means for separating and storing the video stream data and the audio stream data, and 2) the sampling rate of the audio stream data is Determining means for determining whether or not the target sampling rate used for data specification at the time of editing is generated, and 3) if the determining means determines that the audio stream data is not generated at the target sampling rate, Sampling rate conversion means for converting data so that the sampling rate of the audio stream data becomes the target sampling rate, and 4) when an audio stream data editing command is given, the audio stream data is converted based on the target sampling rate. To identify the edit data of audio stream data, and includes an editing means for editing the audio stream data. Therefore, when the sampling rate of the audio stream data is not generated at the target sampling rate used for data specification at the time of editing, data conversion is performed so that the sampling rate of the audio stream data becomes the target sampling rate. As a result, even when the sampling rate of the audio data of the given mixed stream digital data varies, the corresponding audio data can be accurately identified and edited by the editing means. Therefore, non-linear video editing without sound deviation becomes possible.
[0011]
In the mixed stream digital data separation storage device according to the present invention, when 1) the mixed stream digital data is given, separate storage means for storing the video stream data and the audio stream data separately; 2) the audio stream data; Judgment means for judging whether or not the sampling rate is generated at a target sampling rate used for data specification at the time of editing, 3) When the judgment means judges that the audio stream data is not generated at the target sampling rate Includes sampling rate conversion means for converting the data so that the sampling rate of the audio stream data becomes the target sampling rate. Therefore, when the sampling rate of the audio stream data is not generated at the target sampling rate used for data specification at the time of editing, data conversion is performed so that the sampling rate of the audio stream data becomes the target sampling rate. Thereby, even when the sampling rate of the audio data of the given mixed stream digital data varies, the nonlinear video editing apparatus can accurately identify and edit the corresponding audio data.
[0012]
The mixed stream digital data separator according to the present invention is a mixed stream digital data separator that separates video stream data and audio stream data when mixed stream digital data in which video data and audio data are interleaved is provided. ,
Separation means for separating video stream data and audio stream data when the mixed stream digital data is given,
Judgment means for judging whether the sampling rate of the audio stream data is generated at a target sampling rate used for data specification at the time of editing,
Sampling rate conversion means for performing data conversion so that the sampling rate of the audio stream data becomes the target sampling rate when the determining means determines that the audio stream data is not generated at the target sampling rate;
It has.
[0013]
Therefore, even when the sampling rate of the audio data of the given mixed stream digital data fluctuates, the corresponding audio data can be accurately identified and edited by storing the video stream data and the audio stream data in the nonlinear video editing device. can do.
[0014]
In the nonlinear video editing method according to the present invention, when the mixed stream digital data is given, the video stream data and the audio stream data are separated and stored, and the sampling rate of the audio stream data is used for data specification at the time of editing. It is determined whether or not the audio stream data is generated at the target sampling rate. If the audio stream data is not generated at the target sampling rate, data conversion is performed so that the sampling rate of the audio stream data becomes the target sampling rate. When an audio stream data editing command is given, the audio stream data is identified based on the target sampling rate, and the audio stream data is specified. Edit. Therefore, when the sampling rate of the audio stream data is not generated at the target sampling rate used for data specification at the time of editing, data conversion is performed so that the sampling rate of the audio stream data becomes the target sampling rate. Thereby, even when the sampling rate of the audio data of the given mixed stream digital data varies, the corresponding audio data can be accurately identified and edited.
[0015]
In the mixed stream digital data conversion method according to the present invention, when mixed stream digital data in which video data and audio data are interleaved is given, the stream data is separated into video stream data and audio stream data, and sampling of the audio stream data is performed. If the audio stream data is generated at a sampling rate that exceeds the permissible correspondence with each frame data constituting the video stream data based on the measured sampling rate, the audio stream data is generated. Data conversion is performed so that the data sampling rate falls within the range of the association tolerance. Therefore, if the association tolerance is out of the range, the sampling rate of the audio stream data is converted. Thereby, even when the sampling rate of the audio data of the given mixed stream digital data varies, the corresponding audio data can be accurately identified and edited.
[0016]
In the storage medium storing the program according to the present invention, the program determines whether the sampling rate of the audio stream data is generated at the target sampling rate based on a predetermined amount of data from the beginning. If it is determined that the sampling rate of the predetermined amount of audio stream data from the head is not generated at the target sampling rate, the remaining audio stream data is converted without performing this determination. To do. Therefore, it is possible to determine whether or not the adjustment should be made by only obtaining the sampling rate of a predetermined amount of audio stream data from the beginning. Thereby, the processing time as a whole can be further shortened.
[0017]
In the storage medium storing the program according to the present invention, the values of the individual data constituting the given audio stream data are arranged in time series, and a straight line is obtained by linear interpolation, and the virtual straight line is obtained at the target sampling rate. Sampling is performed again to convert the sampling rate. Therefore, simple, high-speed and high-accuracy conversion is possible.
[0018]
In the storage medium storing the program according to the present invention, the program detects the sampling rate stored in the control data of the given audio stream data and sets it as the target sampling rate. Therefore, it is possible to convert to the sampling rate specified by the control data.
[0019]
In the storage medium storing the program according to the present invention, the sampling rate first extracted from the mixed stream digital data is set as the target sampling rate, and the sampling rate stored in the control data area of the given mixed stream digital data is different. Even in this case, the sampling rate is converted at the target sampling rate. Therefore, even when digitized at different sampling rates, it can be converted into audio data of one target sampling rate.
[0020]
DETAILED DESCRIPTION OF THE INVENTION
1. Functional block diagram description
An embodiment of the present invention will be described with reference to the drawings. 1 is provided with mixed stream digital data in which video data and audio data are interleaved, the video stream data and the audio stream data are separated and stored, and the non-linearity of the mixed stream digital data is stored. A non-linear video editing apparatus that performs video editing, and includes a separation storage unit 3, a determination unit 5, a sampling rate conversion unit 7, and an editing unit 9.
[0021]
When the mixed stream digital data is given, the separation storage means 3 takes in the given data, and stores the fetched data into video stream data and audio stream data. The determination means 5 detects the sampling rate of the audio stream data, and determines whether the audio stream data is generated at a target sampling rate used for data specification at the time of editing.
[0022]
When the determination unit 5 determines that the audio stream data is not generated at the target sampling rate, the adjustment unit 7 performs data conversion so that the sampling rate of the audio stream data becomes the target sampling rate. When an editing instruction for audio stream data is given, the editing unit 9 specifies data to be edited for the audio stream data based on the target sampling rate, and edits the audio stream data.
[0023]
In this way, the sampling rate of the audio stream data is measured, and based on the measured sampling rate, the audio stream data has a sampling rate that exceeds the permissible association with each frame data constituting the video stream data. If it is generated, non-linear video editing without sound deviation can be performed by adjusting the sampling rate of the audio data to be within the range of the association tolerance.
[0024]
2. Hardware configuration
FIG. 2 shows an example of a hardware configuration in which the nonlinear video editing apparatus 1 shown in FIG. 1 is realized using a CPU.
[0025]
An embodiment of the present invention will be described with reference to the drawings. FIG. 1 shows a hardware configuration of a nonlinear video editing system 1 according to the present invention. The non-linear video editing system 1 includes a CPU 23, a memory 27, a hard disk 26, a display unit 30, an FDD 25, a keyboard 28, a mouse 31, a DV video capture board 41, and a bus line 29.
[0026]
The CPU 23 controls each unit via the bus line 29 according to a program stored in the hard disk 26. This program is read from the flexible disk 25a storing the program via the FDD 25 and installed in the hard disk 26. In addition to the flexible disk, it may be installed on a hard disk from a computer-readable storage medium in which a program such as a CD-ROM or an IC card is substantially integrated. Furthermore, it may be downloaded using a communication line.
[0027]
In the present embodiment, the program stored in the flexible disk is indirectly executed by the computer by installing the program from the flexible disk to the hard disk 26. However, the present invention is not limited to this, and the program stored in the flexible disk may be directly executed from the FDD 25. Note that programs that can be executed by a computer are not only those that can be directly executed by simply installing them, but also those that need to be converted to other forms once (for example, those that have been compressed) are decompressed. Etc.), and further executable in combination with other module parts.
[0028]
The hard disk 26 stores a video editing program 26e, a data capturing program 26s, video data 26v, audio data 26a, and an operating system (OS) 26w. In this embodiment, Windows 98 of Microsoft Corporation is adopted as the operating system.
[0029]
As the video data 26v and the audio data 26a, DV data from the video camera 43 is captured by the DV video capture board 41 and temporarily stored in the memory 27. Thereafter, the CPU 23 separates and stores the video data and the audio data. Details will be described later.
[0030]
The video editing program 26e is the same as the conventional one. Briefly, when the operator gives a read command, the image data of the specified frame in the video data 26v is decompressed and given to the display unit 30. As a result, the image to be edited is displayed on the display unit 30 frame by frame. The operator cuts and pastes the images of the displayed frames and combines them. At this time, the audio data is simultaneously processed in units of one frame in accordance with the video data. When the desired editing operation is completed, the operator gives a write command. The video data of each frame is compressed in a predetermined format and stored as video data on the hard disk. The video editing program 26e is an application program that runs on the operating system 26w.
[0031]
In addition, the memory 27 stores various calculation results and the like. The display unit 30 includes a graphic card 30a and a monitor 30b, and an image of each frame to be edited is displayed on the video editing screen of the video editing program 26e by executing the video editing program 26e. The keyboard 28 and mouse 31 are input means for inputting various commands (edit start command, edit end command, etc.).
[0032]
3. Flow chart of data import program 26s
Next, the data capturing program 26s stored in the hard disk 26 will be described with reference to FIGS.
[0033]
The data capture program 26s has an interrupt program in addition to the main program shown in FIGS. When the operator gives a capture start command, the interrupt program determines whether or not DV stream data in which video data and audio data are interleaved is provided from the DV video capture board 41, and from the DV video capture board 41. When the DV stream data is given, it is temporarily stored in the hard disk 26. On the other hand, if DV stream data is not given, such storage processing is not performed. Such interruption processing is repeated for each frame period of video.
[0034]
The main program will be described with reference to FIGS. In the following, as shown in FIG. 6C, a data capturing process when the sampling rate of audio data is larger than the standard and the read sampling rate is not changed in the middle will be described.
[0035]
The CPU 23 sets the sampling rate flag = 0 (step ST1 in FIG. 3), and sets the conversion flag f = 0 (step ST11). The CPU 23 determines whether or not new DV stream data is stored in the hard disk 26 (step ST13). If new DV stream data is stored in the hard disk 26, it is separated into video data and audio data and stored in the hard disk (step ST15). If the DV stream data is not stored in the hard disk 26, the process of step ST13 is repeated.
[0036]
CPU23 acquires a sampling rate from the control data of DV stream data (step ST17). Specifically, when the audio data is digitized by the video camera 43, the sampling rate is embedded in the control data, so that the control data may be read out.
[0037]
The CPU 23 determines whether or not the sampling rate flag = 0 (step ST18). In this case, since the sampling rate flag = 0 is set in step ST10, the sampling rate read in step ST17 is stored as a standard value (step ST41). The CPU 23 sets the sampling rate flag = 1 (step ST43).
[0038]
The CPU 23 determines whether or not the sampling rate stored as the standard value matches the read sampling rate (step ST19). In this case, since the read sampling rate is not changed midway, the CPU 23 determines whether or not the conversion flag is f = 0 (step ST21). In this case, since f = 0 in step ST11, the CPU 23 counts and adds the individual data of the separated audio data (step ST23 in FIG. 4). Since the DV stream data is blocked in units of one video frame (see FIG. 6A), the number of samples in each block may be counted. In the DV standard, a one-second moving image in the NTSC mode is composed of 29.97 frames. Accordingly, the time corresponding to one frame of video, the number of samples of 1 / 29.97 seconds, is added.
[0039]
The CPU 23 determines whether or not the counting for a predetermined number of frames has been completed (step ST25). If the counting for the predetermined number of frames has not been completed, the processes in and after step ST13 in FIG. 3 are repeated.
[0040]
If the count for the predetermined number of frames has been completed in step ST25 in FIG. 4, CPU 23 determines whether or not the error is within an allowable range (step ST27 in FIG. 4). For example, when the sampling rate acquired in step ST17 in FIG. 3 is 48 kHz, the average number of samples per video one frame time should be 48 kHz / 29.97 = 1601.60. In the present embodiment, an average of the number of sampling data for a predetermined number of frames is obtained, and it is determined whether or not an error between the average value and the average sample value is within 0.5% or less. I did it. The average is obtained because the number of samples stored per block varies slightly.
[0041]
Note that the allowable range of such errors is not limited to this value, and is set arbitrarily such as a range allowable in the data to be edited, for example, plus or minus 0.3% or less, plus or minus 1% or less. What should I do? Further, an allowable range for the operator may be input.
[0042]
If it is within the allowable range, the CPU 23 sets the conversion flag f to f = 2 and repeats the processing from step ST13 onward. If the allowable range is exceeded, the conversion flag f is set to f = 1 (step ST28 in FIG. 4), and sampling rate conversion processing is performed (step ST29). The sampling rate conversion process will be described with reference to FIG. As shown in FIG. 5A, audio data that requires sampling rate conversion processing is arranged in time series. In this case, as shown in FIG. 6C, since the sampling rate is high, the number of samplings per predetermined time (for example, for one frame) is large. Therefore, the time Δtx between each sample is smaller than the standard value. The CPU 23 calculates a virtual straight line L1 that connects the values of the samples. As shown in FIG. 5B, the virtual straight line L1 is sampled again at a time Δts between samples in the case of a standard value. By this processing, the sampling rate can be converted with almost no change in the frequency and intensity of the audio data.
[0043]
When the sampling rate conversion of the separated audio data is completed, the CPU 23 stores the converted audio data in place of the audio audio before the conversion, and repeats the processes after step ST13 in FIG.
[0044]
In this embodiment, in step ST27 in FIG. 4, it is determined whether the sampling rate is within an allowable range for a predetermined number of frames from the beginning, and the same processing is performed for the remaining frames based on such determination. . That is, once it is determined whether or not it is within the allowable range by the processing from step ST13 to step ST27 in FIG. 3, the conversion flag f becomes f = 1 or f = 2. Accordingly, the process proceeds from step ST21 to step ST22 in FIG. 3, and if the conversion flag f is f = 1, the sampling rate conversion process in step ST29 is not performed without determining whether the allowable range is in step ST23 to step ST27. I do. On the other hand, if the conversion flag f is f = 2, the processing after step ST13 is repeated without performing the sampling rate conversion processing at step ST29. This is because in many video cameras, the sampling rate of audio data does not fluctuate, but is often stable at a value that is shifted up or down compared to the standard value. Of course, it may be determined whether all frames are within the allowable range.
[0045]
That is, in the present embodiment, the conversion flag f indicates that f = 0: sampling rate determination is required, f = 1: sampling rate conversion is required, and f = 3: sampling rate conversion is not required.
[0046]
In this way, even when the sampling rate of the given audio data is deviated, the non-linear video editing software converts the audio stream data into a reference sampling rate used to identify the corresponding audio data. When an editing command is given, an editing target position of the audio stream data can be specified based on the target sampling rate. Thereby, it is possible to avoid the problem of sound deviation during editing.
[0047]
In this way, by adjusting the sampling rate error at the time of capturing audio data, video editing can be performed without any sound shift.
[0048]
Next, a case where the read sampling rate is changed halfway will be described. The following four types of audio data of DV data are employed.
[0049]
1) Sampling rate 48kHz, data length 16 bits
2) Sampling rate 44.1kHz, data length 16 bits
3) Sampling rate 32kHz, data length 16 bits
4) Sampling rate 32kHz, data length 12 bits
The video camera can switch the sampling rate of the audio data during recording. However, if the sampling rate is switched in the middle, the non-linear video editing software will not be able to cope with such switching, and will not be able to capture data and will stop, or even if the data is captured, it will be stored silently, eventually resulting in audio data Could not be imported correctly.
[0050]
Therefore, in the present embodiment, even when the sampling rate is switched halfway, the editing operation in the non-linear video editing software is enabled by automatically performing the sampling rate conversion process at the sampling rate extracted first. Hereinafter, a case where the sampling rate is switched from 48 kHz to the sampling rate 44.1 kHz will be described as an example.
[0051]
The CPU 23 obtains the sampling rate from the control data after separating the video data and the audio data (step ST17). Then, referring to the sampling rate flag in step ST18, only when it is not stored as a standard value, it is stored as a standard value (step ST41), and the sampling rate flag = 1 is set (step ST43).
[0052]
On the other hand, once stored, it is determined whether or not the sampling rate stored as the standard value matches the read sampling rate (step ST19). Such a determination can be made based on whether or not the sampling rate 48 kHz stored as the standard value becomes the sampling rate 44.1 kHz.
[0053]
When the sampling rate is switched halfway, the CPU 23 sets the audio data conversion flag f to f = 0 (step ST31) and clears the counter (step ST33). And the process after step ST29 is performed.
[0054]
In this way, when the sampling rate is changed in the middle, it is possible to sample at the sampling rate detected first instead of converting to the sampling rate designated by the subsequent control data.
[0055]
3. Other embodiments
Note that the DV data provided from the DV video capture board 41 is stream data, and the same applies to not only a tape but also a DVD disk, regardless of the type of storage medium.
[0056]
Whether or not the sampling rate of the audio stream data is generated at the target sampling rate is determined based on a predetermined amount of data from the beginning, and the sampling rate of the predetermined amount of audio stream data from the beginning. However, if it is determined that the data has not been generated at the target sampling rate, the data conversion may be performed on the remaining audio stream data without making this determination.
[0057]
Further, in this embodiment, the values of the individual data constituting the given audio stream data are arranged in time series, a straight line is obtained by obtaining a virtual straight line, and the virtual straight line is sampled again at the target sampling rate, The sampling rate was converted. Thereby, if the frequency is high, the error is small and the calculation is easy. However, supplementary processing may be performed by a method other than this, for example, a virtual spline curve may be obtained, and the data conversion may be performed based on this curve.
[0058]
In this embodiment, the sampling rate stored in the subcode storage area in the given DV data is detected and set as the target sampling rate, but it may be a fixed value. Furthermore, a sampling rate stored in a control data area of mixed stream digital data other than DV data, for example, MPEG data may be detected and set as a target sampling rate.
[0059]
Further, as the target sampling rate, a sampling rate first detected from the DV stream data may be used.
[0060]
When the converter is built in a general-purpose computer, an operating system (OS) program may execute the program. In other words, the program may be executed alone or shared with the operating system (OS).
[0061]
In the present embodiment, the CPU 23 is used to realize the function shown in FIG. 1, and this is realized by software. However, some or all of them may be realized by hardware such as a logic circuit. For example, sampling rate conversion may be performed by a logic circuit, and sampling rate tolerance determination may be performed by software. Further, processing performed by some hardware may be executed by the CPU.
[0062]
In the present embodiment, the program shown in FIGS. 3 and 4 is installed in the hard disk, and the DV stream data given from the DV capture board 41 is temporarily stored in the hard disk 26 to determine whether or not to convert the data. However, a separate CPU and ROM may be mounted on the DV capture board 41, and the program may be stored in the ROM so that the DV capture board 41 can output DV stream data having the same sampling rate. . In this case, a memory for storing audio data for a predetermined frame from the beginning for performing the determination in step ST27 may be prepared. In this case, since the video data need not be converted, the video data may be sequentially transferred to the hard disk 26. As a result, the memory prepared in the DV capture board 41 may be a memory that stores audio data with a relatively small amount of data. Of course, a memory for storing all stream data may be mounted until the determination is completed.
[Brief description of the drawings]
FIG. 1 is a functional block diagram of a non-linear video editing system 1 according to the present invention.
FIG. 2 is a diagram illustrating an example of a hardware configuration in which the nonlinear video editing system 1 is configured using a CPU.
FIG. 3 is a main flowchart of a data capturing program.
FIG. 4 is a main flowchart of a data capturing program.
FIG. 5 is a diagram for explaining sampling rate conversion;
FIG. 6 is a diagram illustrating a correspondence between video data and audio audio.
[Explanation of symbols]
1 ... Nonlinear video editing device
23 ... CPU
26s ... Data acquisition program
26e ... Video editing program
41 ... DV video capture board

Claims (10)

A non-linear video editing apparatus that, when given mixed stream digital data in which video data and audio data are interleaved, separates and stores video stream data and audio stream data, and performs non-linear video editing of the mixed stream digital data. ,
When the mixed stream digital data is given, separate storage means for separating and storing video stream data and audio stream data;
Judgment means for judging whether the sampling rate of the audio stream data is generated at a target sampling rate used for data specification at the time of editing,
Sampling rate conversion means for performing data conversion so that the sampling rate of the audio stream data becomes the target sampling rate when the determining means determines that the audio stream data is not generated at the target sampling rate;
An editing means for editing the audio stream data by specifying editing target data of the audio stream data based on the target sampling rate when an audio stream data editing command is given;
A non-linear video editing apparatus characterized by comprising: A mixed stream digital data separation and storage device that separates and stores video stream data and audio stream data when mixed stream digital data in which video data and audio data are interleaved is provided,
When the mixed stream digital data is given, separate storage means for separating and storing video stream data and audio stream data;
Judgment means for judging whether the sampling rate of the audio stream data is generated at a target sampling rate used for data specification at the time of editing,
Sampling rate conversion means for performing data conversion so that the sampling rate of the audio stream data becomes the target sampling rate when the determining means determines that the audio stream data is not generated at the target sampling rate;
A mixed stream digital data separation and storage device comprising: A mixed stream digital data separation device that separates video stream data and audio stream data when mixed stream digital data in which video data and audio data are interleaved is provided,
Separation means for separating video stream data and audio stream data when the mixed stream digital data is given,
Judgment means for judging whether the sampling rate of the audio stream data is generated at a target sampling rate used for data specification at the time of editing,
Sampling rate conversion means for performing data conversion so that the sampling rate of the audio stream data becomes the target sampling rate when the determining means determines that the audio stream data is not generated at the target sampling rate;
A mixed stream digital data separation device comprising: A non-linear video editing method in which video stream data and audio data are interleaved, and when the mixed stream digital data is given, the video stream data and the audio stream data are stored separately, and non-linear video editing of the mixed stream digital data is performed. ,
Given the mixed stream digital data, separate and store video stream data and audio stream data,
It is determined whether the sampling rate of the audio stream data is generated at a target sampling rate used for data specification at the time of editing,
If the audio stream data is not generated at the target sampling rate, data conversion is performed so that the sampling rate of the audio stream data becomes the target sampling rate,
When an audio stream data editing command is given, based on the target sampling rate, the editing target data of the audio stream data is specified, and the audio stream data is edited.
A non-linear video editing method. When mixed stream digital data in which video data and audio data are interleaved is given, it is separated into video stream data and audio stream data,
Measuring the sampling rate of the audio stream data;
Based on the measured sampling rate, if the audio stream data is generated at a sampling rate that exceeds the association tolerance with each frame data constituting the video stream data, the sampling rate of the audio data is set. Data conversion to be within the range of the association tolerance;
A mixed stream digital data conversion method characterized by the above. A storage storing a program that causes a computer to function as a mixed stream digital data separation storage device that, when given mixed stream digital data in which video data and audio data are interleaved, is separated and stored into video stream data and audio stream data Performing the following processing on the medium:
Given the mixed stream digital data, separate and store video stream data and audio stream data,
It is determined whether the sampling rate of the audio stream data is generated at a target sampling rate used for data specification at the time of editing,
When the audio stream data is not generated at the target sampling rate, data conversion is performed so that the sampling rate of the audio stream data becomes the target sampling rate.
A storage medium storing a program characterized by the above. In the storage medium which memorize | stored the program of Claim 6,
Whether the sampling rate of the audio stream data is generated at the target sampling rate is determined based on a predetermined amount of data from the beginning,
If it is determined that the sampling rate of the predetermined amount of audio stream data from the head is not generated at the target sampling rate, the remaining audio stream data is converted without performing this determination. ,
It is characterized by. In the storage medium which memorize | stored the program of Claim 6,
Arranging values of individual data constituting the given audio stream data in time series, obtaining a virtual straight line by complementing the line, sampling the virtual straight line again at the target sampling rate, and converting the sampling rate ,
It is characterized by. In the storage medium which memorize | stored the program of Claim 8,
The program detects the sampling rate stored in the control data of the given audio stream data and sets it as a target sampling rate,
It is characterized by. In the storage medium which memorize | stored the program of Claim 9,
The program uses the sampling rate first extracted from the mixed stream digital data as the target sampling rate, and even if the sampling rate stored in the control data area of the given mixed stream digital data is different, the target sampling rate is used. Sampling rate conversion,
It is characterized by.

Images